hello david
i don't have experience of the webley service but if it's anything like the mk3 webley, it's a friction fit (v fine tolerance) so that it can be tapped one way or t'other for the windage.
yours may need some gentle 'tapping with a brass drift or something similar to close the dovetail a little.
if you do 'have a go' use something soft like the brass drift or a piece of solid copper (don't use lead though, it would be too soft)
or it could i suppose be brazed in if it's really loose, i think the foresights on the mk3 are brazed (but i'm probably wrong
john