Personally I wouldn't use stainless as it has a propensity to gall in high friction applications.
Most steels EN8 or better should be more than adequate in their natural state and in a pivot you want the pin to wear out before it starts enlarging the hole which is more difficult rectify as you lose the centre and increase the diameter each time.