Well at least if you miss the bad guy will be deaf and blind , of course you may well be too.If you want a rifle in a handgun fight, why not pick a handgun that provides rifle like ballistics? We have those now.
First one that comes to mind is the Hornady 200 grain HP at 2300 fps, out of the .460 S&W.
Others: .500 JRH, .500 S&W, .500 Linebaugh, .475 Linebaugh, etc. All provide 50-110 type ballistics out of a handgun.
Of course now if it's old Mr. Ursus Horribilis breaking y'alls bedroom you might have a point.