No, the reason he was not gimping himself was because the game was made so you didnt need magicka if you didnt want it and you didnt need stamina if you didnt want it.
I understand that abilities like teleport and invisibility cannot be stamina based because its obviously magic, but having some class abilities going with stamina would have been nice.
I just think we are lacking abilities that use stamina. If I want to make an archer with ranged stamina abilities, my choice is extremely limited, but if I want to make a sorcerer with ranged magicka abilities, my choice is way larger.
No, the best builds were stamina-based fighters abusing enchants, or any stealth with overpowered sneak attacks.