Recently, the authors introduced a preconditioner for the linear systems that arise from fully implicit Runge-Kutta time stepping schemes applied to parabolic PDEs \cite{mns}. The preconditioner was a block Jacobi preconditioner, where each of the blocks were based on standard preconditioners for low-order time discretizations like implicit Euler or Crank-Nicolson. It was proven that the preconditioner is optimal with respect to the timestep and the discretization parameter in space. In this paper we will improve the convergence by considering other preconditioners like the upper and the lower block Gauss-Seidel preconditioners, both in a left and right preconditioning setting. Finally, we improve the condition number by using a generalized Gauss-Seidel preconditioner.