I tend to go with Heavy.
Currently playing as a mage-type-build using ([dual] enchanted robes, ring, necklace and Vokun) ebony boots and gauntlets. Eventually, il put 5 perks in Juggernaut, and 1 in Fists of Steel; I really like the unarmed kill scenes and for strange some reason, beating people to death is really satisfying.
In terms of Smithing, the perks i use are Steel Smithing, which then allows me to get Arcane Blacksmith perk. Arcane blacksmith allows you to Smith any Enchanted item, which is awesome! You can wear any armour you like without using valuable perks. Find or buy ebony or daedric armour, enchant it, then Smith it. Bish, bash, bosh, bob's your mother's brother!
When combined with Alchemy (5 perks in Alchemist, 1 in Physician, 1 in benefactor) and Enchanting (5 Perks in Enchanter, 1 Insightful Enchanter, Corpus Enchanter and Extra effect) you can make some fantastic combinations of potent robes, jewelry and seriously powerful armour.