Purely down to the safety aspect you don't want to be wandering around with a loaded & cocked rifle when it can be avoided, and as it's silent & instant to cock a PCP wait until you spot a target and start the final close stalk.
Will it actually cause damage? no.