In the case of the Colt 1848 Baby Dragoon Rammerless Pistol (aka the so-called Wells Fargo model), the end of the arbor is concave and could be used as a rammer to load the cylinder off the revolver. I would think that repeated use as such might weaken the arbor attachment point at the frame.
Jim