Perhaps it is just me, but I find this to be true since Morrowind. I think most quests reward you with items like shields, swords or light/heavy armor. I don't use any of this stuff with almost all of the characters I create. There aren't enough items like really powerful amulets or rings. Granted Morrowind and Oblivion had custom spell-making, but I think the whole series leans more towards sword and board than magic.
I was inspired to write this topic having just finished Peryite's quest (again). Lo and behold another shield as a reward, not a robe with 60% spell resistance, a staff which makes enemies disappear or something of that sort.