Take the recoil pad off and tighten the stock bolt.
Every O/U I have owned has had the recoil pad held on by Phillip's head screws. There are slits in the pad where the heads are. If the pad hasn't been off, you probably can't see them well, but they are there. Use some dish soap to lube the screwdriver so it goes in the slit better and turns smoother.