Muzzle flip is not the problem. Consistent hold and pressure is.
The rifle goes through the same cycle every shot, the only inconsistency is the shooter.
I have a 95 in .22 I have short stroked and fitted a 98 barrel to combat its liveliness and it’s really nice to shoot, but it is really not at all forgiving of changes of grip pressure, etc.
In a nutshell - practice, practice. If you struggle, a heavier rifle may be the answer?