Numerical solutions to linear transfer problems of polarized radiation IV. Efficient preconditioning in a physics-based framework