Introducing Berry phase gradients along the optical path via propagation-dependent polarization transformations