With the Boltgun, Revolver and Shotgun, viewmodel sway from panning the camera interferes with viewmodel recoil animations, creating a very jittery sight picture. If you’ve ever been aiming with one of these guns an experience a rubberbanding effect on your sights, this is the reason.
The Boltgun seems especially affected, as even moving and stopping will cause jitter.