I keep getting this remark from every Imperial guard, every time I pass them by. I'm in good standing in the Imperial Legion but they still say it?

Hmm... this usually happens when you are expelled from the legion. You SURE you didn't accidentally do anything to piss them off? Attack them, steal their stuff or something?