The fact that all characters in TES games start with one or two minor spells sort of supports this, though. The lore explanation the book gave is pretty sound, too - that all mortals have a tiny piece of Aetherius deep inside them left over from Convention, a little piece of their soul that allows magic to flow through them, and sometimes in desperation it can activate. Doesn't seem that far fetched.
No, it certainly doesn't considering anyone has the capability to use magic. My problem is though, that without even a speck of training, could that really manifest itself in some form of defense? Grant it, 'life and death(!)' scenario could be enough of a stimulant to allow something like that to happen, it raises the question would exactly would manifest, since I'm almost certain no proper spell would come to be. Either way, what happened in the book just seems to plotty for me to properly sell it. I'm sure it could happen in a way that could be more believable though.