No idea what has caused this. I can not have a follower.

I have had some problems with the Unofficial Patch not allowing me to take dragon souls (no matter which version of the patch I use) but since disabling it I keep being told that I have a follower when I don't.

Any suggestions as to what to do?