Hmm... most people die from using that scroll. Well done.
I swam from Vvardenfell to Solstheim (just to say that I did), but never the other way.
BTW, never swim from Vvardenfell to Solstheim without being invisible or chameleoned. Those fish probably won't kill you unless you just got off the boat at Seyda Neen, but you'll definitely be inclined to nuke them in the CS.