I am finding the entire quest line of the college rather ridiculous. You need not be able to cast spells, follow the quest line for a few hours and WHAM! You become the head honcho. At the very least they could have had some enemies like the magical anomalies entirely resistant to physical damage.
Anyway, is there some mod out there that reworks the quest line and makes it difficult or near impossible for a non magic user to finish the quest line?