Is there any way to fix this? it really bothers me, and I have no idea what triggers it.

http: // i. imgur.com / yWbbNkQ . jpg

Have you had a look at this post on the Nexus?

http://forums.nexusmods.com/index.php?/topic/872861-tutorial-removing-unwanted-magic-effects-from-the-player/

I used bat cure all and it does fix it temporarily, only to get back later after a short while. :\