yes.. if the gun's action slides backwards at say 20fps, then you will get a reading 20 fps lower. One could argue that is the real reading - ie that's the velocity the rifle discharges a shot at.
but you seem to have got a 5 fps variance with the action locked forwwards - which makes sense - but a much bigger one with the scope fitted - which doesn't.