If your scope is clamped onto the rail, why is the zero supposed to change when you take off and replace the stock?
(Confused beginner!)
The ox is slow, but the earth is patient.
The tightening of the stock bolts "can" cause small deformations in the metal of the action. Small but big enough to change your zero.
Doesn't always happen but it's best to check.