I'd take the part out and polish the engagement edge of the slide catch so there is less friction when pushing it down. I do this anyway on every gun I intend to shoot a lot.
Also, there is no reason to ever do this with an empty mag in it anyway... the follower is pressing up on the slide catch, and you're having to overcome the frictional tension and the mag spring tension... any time you are loading the gun from slidelock it is not going to be empty obviously, so just adjust it with no mag in the gun.
In my full size M&P pro, in about 32k+ rounds, I broke the slide catch once... and it was still functional. The left side thumb pad broke off. The kicker: I'm left handed, and in the event the slide didn't auto-forward, I would always press the right side button with my left thumb. So the part that broke off, was a part that I was NEVER pressing.
It is a cheap part... buy a couple extras, and if you ever break it, it is a 10 minute job to replace. No way in hades I'd spend weeks and possibly pay shipping to send a pistol somewhere for a warranty replacement of a ~$5 consumable cookie cutter part.