Ideally, the slider needs to be removed from the body of the sight and then gently tightened before it is re-mounted.
I've not taken one apart, so can't advise on how best to do so.
I once owned a shiny refinished No 3 Bore with the same issue and used black insulating tape to create extra friction, which worked up to a point.
John
Currently looking for Baikal Makarov pistols with the following prefixes to the serial number: 98, T01, T09, T21, T22
Prefer boxed or cased but will consider loose examples too.