Each component of the new iterates in Gauss-Seidel method depends upon all previously computed components, the updates cannot be done simultaneously.