This. I agree. Just as the character models are getting a huge overhaul, I am sure we'll see some new voice work as well. If not, I'd be disappointed.
I had always thought there must be some historical explanation for the voice. I mean, they were changed to Dunmer, getting dark gray skin and red eyes....so perhaps they all inhaled a bunch of volcanic ash from the events at Red Mountain and then from subsequently living there. I mean, when I first heard that voice, the first thing that popped into my mind was: smoker.
Ever heard an old smoker? Or someone with emphysema? That voice is actually very similar to those imo. Perhaps that was the intent when they decided on a voice for them originally....
Considering they only decided to call the game The Elder Scrolls because it sounded magical and cool, why could they not have chosen the Dunmer voice for Baker to do because they figured the Dunmer might sound like that from living in Morrowind (AKA the Ashland)???
Anyway, whatever the reasoning for the voice, I think some updating and variety amongst NPCs, including male and female voices, are called for to make Skyrim that much better.
They're not human, so there's really no need to even consider physiological differences for different voices. That's just what the Dunmer voice was. It was meant to be used in Oblivion, but was scrapped later on, like so many other things that were meant to be in.
The gravely voices gave them a lot of character, and really went a long way to show the grim nature of Dunmer. In lore they were described as being gloomy and aloof. A voice that is fairly consistent emotionally is rather good for them.