I wanted to try a build in which I would do as little direct damage as possible, instead remaining hidden in the shadows gleefully admiring the chaos, fear and death I've generated through my knowledge of the Arcane Arts.

A preliminary build I've come up with is as such:

Conjuration: Novice-Master, Mystic Binding, Soul Stealer, Oblivion Binding, Summoner 1/2, Atromancy, Elemental Potency, Twin Souls

Illusion: All perks

Alteration: Novice-Expert, Mage Armor 3/3, Stability

Enchanting: Enchanter, Insightful Enchanter, Corpus Enchanter, Extra Effect

Archer: Overdraw 5/5

Sneak: Stealth 5/5, Backstab, Deadly Aim

These are the skills I wish to use. Nothing more, nothing less.

However, if anyone sees any fat in the perk spread that could be trimmed I'm all ears.

Thanks in advance.

I had a character like that. You might not need the mage armor at all if you are taking advantage of all of the illusion skill.

Especially with that much invested in stealth too.

True. I had it in there as a simple "OH SH@T!!" defensive measure, although simply going invisible would be just as effective and reduce the perk spread I suppose.

Just run away. This character doesn't have combat skills anyway. Even with mage armor, he will die. Run away, cast invisible, and go back to sneaking.

Yep, I also had a character like this, but with Destruction instead of archery.

He also happened to be a bit more "hands-on" and destroyed things along with his summons. I was able to survive with only 100 HP the entire playthrough. (On Adept, mind you)

Also, although I used the skill I never took any perks in Sneak. Muffle and Invisibility made it extremely easy to sneak around undetected. Since you're incorporating Archery and backstabbing into your playstyle, it looks like you might need it, though.

Ya know, I might just go for destruction instead of archery to keep it inline with the characters personality.

I play a mystic archer who uses conjuration to summon her bow and atronachs. She uses illusion extensively. Plenty of sneak. Alteration only for detect life.

No heavy, light or mage armor or melee skills at all. Fear/calm is her close up panic defense when needed.

The bad news is that illusion takes a lot of investment to realize its potential. The good news is that if illusion is properly used, you don't need melee or armor skills.

I love being a sneak destructionist with quiet casting. Hit 'em from afar and quickly cast invisibility. Your magicka regeneration will not go into the slow combat regen if the sneak eye doesn't completely open. That previous sentence was quite strange, but I think you know what I mean.