Fair? Maybe not, but how do you go about micro managing every population when you don't know?
You're probably right.
Carrying capacity does vary. Generally biologists would like to see populations managed well below carrying capacity, say 60-70% (depends on the species). Of course they don't have the tools to do that. In some states where they have $ they manage wt's down at 40-60% of carrying capacity to maintain productivity. Anyways, if we were able to do that it would keep the critters more productive (twins, antler growth, breeding, body condition) and the population also rebounds far more quickly after a severe winter.
Hunters like to see lots of critters where the opposite result is true. Reduced antler growth, twinning, body condition and huge winter kills in moderate winters.
I believe the current hunting seasons in regions 3,4,8 are pretty much fail-safe in terms of the potential of over-harvest. We're just following or perhaps even encouraging nature's ups and downs. We've become accustomed to seeing a pile of deer and believe that's what is best or we compare an area that had a huge burn 30 years ago to an area that is now full of pecker poles.
As you know populations are controlled through the antlerless or female component. That's how you control things but that's also where fear lies.