There are holes. I guess it's stereotypical at best? If we were to call all Redguards swordsmen. Bosmer, archers. Maybe a mix of nature-nurture.
One example would be the Altmer weakness to the elements. It did not come from a physical weakness but was due to a greater understanding of how magic works and what it does to them.
I remember wondering about that. There was a line about so-and-so game's dwarves that made them "hardy against magic, which also makes them terrible spellcasters." I think it was d&d, i can't remember. Relates to TES orcs though, with their former magicka resistance. Though i suppose it's backwards. I don't know if their warrior-culture created an anti-affinity, or if the lack of magic produced the warrior. Goes in circles!
Altmer would be the opposite extreme. They're so in tune that it hurts them, like The Apprentice sign.
But then bretons tick me off with having the best of both. I couldn't understand that at all.