I'd think that over pretty hard, Juiceking. We're only allowed one deer per year (and it better darned well have antlers) here in Idaho too. Besides that, as I've said in several of my other posts, only 1 in 3 Idaho deer hunters even get a deer.
On the other hand, back in the '90s the company I was working for sent me back east to Maryland for a "Train the Trainer" school. Because the school was close to Washington D.C., and neither my wife nor I had ever been there, she went with me, and we took a couple of weeks vacation so that we could tour that part of the country and see Washington after I was through with the schooling.
We rented a car and drove around all over the place - West Virginia, Virginia, Maryland, Pennsylvania (and of course Washington D.C.) while we were there. We'd never seen so many deer in our lives! It seemed like they were everywhere we looked!
The flip side was, there were people everywhere too. And the traffic?!? Naturally there was also a heck of a lot of dead deer on the roads and alongside the roads.
Besides all that, I don't know what it's like in New Mexico, but my wife and I will be going deer hunting on opening morning the Sunday after next. And if we feel real energetic, we'll drive about 50 miles over to Georgetown Summit for it. If we're feeling lazy, we'll just hunt in the hills around home. Either way, we won't have to ask permission, or have a hunting lease because we'll be hunting on public land - BLM or Forest Service land.
Almost 2/3rds of Idaho is public land, and even though there's not a great many deer here, we don't have to ask permission or lease/buy land to hunt them on. Of course it's nice to have rancher friends (we do) that will let us hunt on their land too. We'd be doing that this year except for the fact that our rancher friend's land is in a draw hunt area, and we forgot to even put in on the draw until it was too late.