I noticed that resetting the view position with MMB+LMB displaces the camera to the opposite side of the original position if there is a head displacement (controlled by <limits> and <x-offset-max-m>).
Reproducing:
I guess this occurs due to some leftover code trying to take the head displacement in account for some reason, and adds it to the config original.
@cgdae, tagging you as view-master ;-)
I was able to confirm this on current next. Looks like this may have something to do with
view.pilot_view_limiter()