Okay, so I was walking through Solitude and randomly saw a Dragon tail sticking up out of the ground. When I got near it, it burned up and gave me it's soul like normal. I looted it and shot it outside of the city walls with a firebolt to get rid of it and moved on. Then later, I walk out of a building in Solitude and the same Dragon appears in front of me with it's skin back on (and I can't absorb it's soul). So I shot it outside of the walls again and hoped to never see it again.
I fast travel to Katla's Farm, turn around and there he is again! I'm getting a little worried now. So I fast travel back to Solitude to see if it's really following me, and sure enough he appears at the gates with me. I exited the city through the stairs that lead to the coast, and he appears there too. So I fast traveled to Whiterun (thankfully, he didn't follow me there), hid in my house and waited 12 days. I went back to the last place I saw him and he wasn't there. I fast traveled back to Solitude and he wasn't there. I was beginning to feel relieved, but then he pops up again when I leave the city.
I've checked, and all the saves I've made since completing the main quest (which was a LONG time ago, guess I don't visit that part of Solitude often enough), he's there, waiting for me to absorb his soul.
Can someone help me get rid of this thing!? I really don't want to have to practically start over...
Thanks.