The Loremaster
Race: Breton
Looks: frail old man with long, unkempt white beard.
Perks: illusion, restoration, enchanting, speechcraft
Story: the Loremaster is a scholar, obsessed with gleaning ancient lore from old dusty tomes. As such, he has no combat experience whatsoever, despite being a capable spellcaster. When he learned that dragons were roaming the land of Skyrim, he became inexplicably compelled to abandon his cloistered existence and journey east to learn all he could about dragon lore. Never in his wildest dreams could he have imagined he was Dovahkiin and would soon embark on an epic adventure fraught with wonder and peril.
Gameplay: the Loremaster is incapable of dealing damage, as he is too frail to wield weapons, and inexperienced in destruction magics, so he relies heavily on a companion to kill stuff. He uses his spells and enchanting to buff and heal his follower. Because he is obsessed with dragon lore, he will only do the main quest and ignore all side quests, so it'll be a quick playthrough.

Tell me what you think.

I've been playing very similar for 50+ hours so far - but I've largely ignored the main quest, I just want to build my library!

Good idea!!

I see no reason why you can't at least pick up Alteration as well for a bit of defensibility.

You can, but you will need to invest heavily in the illusion and restoration perks so I doubt you will have enough for alteration unless you ignore enchanting and speechcraft or you do a normal run (instead of main quest only). But yes, alteration spells are very in line with the character so there is no reason why you shouldn't use them.

Haha! Sounds awesome!