The stainless Officer was my first pistol. It is definately heavy and has a sharp, but not unreasonable, recoil. Mine has had work done to it... but is still not 100% reliable. It was a gift from my father years ago so I will keep it forever, but probably won't really carry it again. I have had a variety of failures with a variety of factory and hand loads with a variety of magazines (including Wilsons).
It is definately my nicest carry gun. Best looking... and least realiable. The three Colt's I have ever owned (Officer, Gunsite, AR-15) have all had reliabilty problems.
That said I am now looking to buy an XSE.
If the Officer model you are looking at is reliable, then the only possible downside is the weight.