I suppose you have a point but I would think there would be a danger of removal of your black powder licence. They could give all sort of reasons.
Do they have to charge you when they remove your guns if you have neighbour trouble or a domestic.? I dont think I will risk it.