With handguns, I tend to shoot/practice/buy for self-defense. So, I avoid any recoil that prevents fast and accurate follow-up shots. .38 SPL, , .380, 9X18, 9X19 & 7.62X25 I can shoot accurately and very fast. .357 I can shoot accurately but the kick prevents me from staying on target so, no .357 in my place.
I carry a Kel-Tec P3AT and some have complained about its recoil; it's very shootable for me. The Polish P-64 was on the edge of "too uncomfortable." Even with a stronger recoil spring, that thing bangs the hand. It would help if every edge on it wasn't so sharp, especially on the trigger. It's not fun to shoot.
I once shot one round of all-out .357 from one of those very light weight S&W J-frames and immediately gave it back to the owner. My immediate, first impression, after about 2-3 seconds of initial, stunned mental numbness, was "***???!!! What sick maniac came up with this idea?"
With longarms, 8MM Mauser is my most powerful kicker. It is a pleasant thump but, after 30-40 rounds, it does start wear on one. I have no desire to beat up my shoulder with any stronger than that. I'm no hunter so I have no need for big 'uns; I just like Mausers.
Yes, recoil does affect my buying.