That's the only thing I don't understand about the whole Talos ban. The Thalmor want his worship banned because he beat the First Aldmeri Dominion when he was alive, and he's also a Man, which the Aldmeri Dominion despise, so him being accepted as a god is disgusting to them. The Nords don't like it because he's revered as a great Nord war hero. But the Imperials, the people who should be the most concerned, just shrug it off. Why?