I plan on playing my first character as an all out mage type player, and was wondering if it will be possible to have a spell in one hand and a shield in the other? Has anyone else thought of this as well? I am just wondering what people would think of my idea, if possible.

Totally possible. Hell, battlemage was a class back in Oblivion.