Make SURE that the gun is aligned with your forearm bones! If you are "reaching around" to get enough finger on the trigger, the base joint of your thumb is going to take a POUNDING. Your height of 5-06 makes me think this might be the case, unless you have huge hands for your size.
I am 6 feet tall, and an S&W N-frame is too big for my hands. (I wear size medium gloves.) No matter how skimpy the grip, I cannot get enough finger on the trigger in double-action mode. This means my grip will be too far out of line, and the skimpy grip panels, of course, allows the gun to try to take apart the base joint of my thumb.
I can do two things if I want to shoot big bore revolvers: shoot the N-frames and Redhawks in single-action mode only, or forget those guns, and use various single-action sixguns that have smaller grip frames. I went with option two. If I am going to cock the gun, anyway, I might as well carry the relatively slimmer, trimmer single action sixguns. (except for one gun, as explained below.)
There is another option, if your N-frame is old enough to have a SOLID, FORGED trigger. A good 'smith can narrow and dress down the trigger face, as was the case with my Model 58 .41 Magnum. I still have to use skimpy grips, though, with no rubber over the backstrap, so my poor wrist bones don't appreciate the recoil, even if the gun fits, and the web of my hand is OK. I have kept the M58 for sentimental reasons; it was my duty sixgun for several years, during some exciting times, though it was never fired in anger.
Edited again to add: If you like the gun, don't sell it. Pay attention to the options, and work with it a while. I sold off my M629 in the mid-1980's, and regret it today.
Back to the forearm bones alignment: This is checked by looking along the top of your arm and the gun. If your hand's bones are in line with arm bones, to get enough finger on the trigger, you are doing it wrong, in an effort to make your hand fit the gun. Don't do that; make the gun fit your hand. You can get a used narrow trigger, and have a good 'smith dress it down, which will preserve your original trigger, and allow you to return the gun to stock configuration. This replacement trigger will almost certainly need to be fitted by a good 'smith.
The grip size issue can be a dilemma, as rubber grips which cover the backstrap will provide a cushion, but that makes it less likely your hand can be positioned properly, as they increase the distance from the back of the grip to the trigger face. Rubber grips which leave the backstrap exposed still allow your fingers and hand to have a better hold on the gun, which still helps to control recoil.
Another member posted a caution against holding too high. Well, don't hold too low, either. I make sure the web of my hand is as high as possible, without any of it rolling over the top of the frame behind the hammer.