Thanks for the replies.
The hole isn't perfectly round, but fairly close. I've had the slide off and I can put the piece back in just fine, with a few tabs from a hammer, but it pops back out after the first time I pump the rifle.
Yes, mine was just pushed in, not threaded, and then spotted it...