Well, I saw an interesting thought in the current Dragonborn discussion thread.
Apparently they're called "Ash Spawn" - an interesting name. Possibly linked to the Red Year? Victims of it? Perhaps.
And then
Didn't Vivec and a bunch of Dunmer get imprisoned in ash, which Vivec cured? Part of the ash shell is the Ashmask of Gnisis. This time, Vivec isn't there to help them.
I really like SithisLorkhan's thought, but I haven't given it a background check. I'll do that now.
EDIT: From The Pilgrim's Path:
In the Days of Fire when Dagoth Ur first crept back into Red Mountain and awakened it, Vivec led refugees here as they fled the ash and blight. Weary, they rested here a while. When Vivec awoke, he found himself and all his followers encased in casts of grey ash. Frozen like a sleeping statue and unable to free himself or help his people, Vivec was filled with despair. Vivec's tears weakened his ash cast. He tore the ash from his perished followers, breathed life into their lungs, and cured them of the blight. This is Vivec's heroism -- his tender heart provides strength when his might fails.So although I really like SithiLork's theory, it seems a bit odd that these 'Ash Spawn' would be able to move, if they truly are connected to the ash-locked refugees mentioned in regards to the Ash Mask, that is. Also, these guys seem to have rounded human ears rather than pointed Dunmer ears, which is odd (in general, considering that they most likely came from Morrowind one way or another. Perhaps local Nords were turned into Ash Spawn?).