For unknown reasons my game keeps freezing after traveling for a bit with my character wife mjoll.

Things I have tried:
1. clearing game cache and the xbox
2. Different games
3.different xbox
4. Different characters out of 3 the other newer ones don't freeze only my first created character.
5. Dowloading the game again.

I know for certain the problem its just in my first character account and when I have a follower, even undead ones with the dead thrall spell.

Does anybody else know how to solve this problem?

You could try disabling all auto saves to see if that helps. There are a lot of bad bugs in the game that have gone unfixed by Bethesda. This often times will lead to the game becoming unplayable after a certain point, because the Xbox 360 console has difficulties handling so much data. One example of this is the fact that weapons and shields do not clean up along with dead bodies and this can eventually put a lot of strain on the console, which leads to instability, lagging, and eventually freezing.