I do that occassionally and it aint no big deal. Really... just pop it out slowly and gently with your decap die. Put another in like you just did only th right way. Primers are made to go off with a quick, sharp impact, like hitting one with a hammer, not a de ap pin in a hand operated reloading press.
Added comment: I've had primers swap ends in both BIG bore rifle cartridges and pistols too, I can remember a few over the years. A 270 win, a 357 mag, 9mm, 45 acp, and all we're usuually done because I was in the rythum and it just happened before I could correct it. They were popped out with the pres too... I'm still here and still have all my fingers, and the press is still working even after 4 decades of abuse. LOL