Most fibre optics are the enemy of precision. They are only good for quick shots on big things.

Try cutting some bits of black electrical tape to cover up the fibre optics and see if your groups improve.