Whenever I wear it I cannot talk to anyone apart from guards and brotherhood members, plus citizens also stare at me and constantly turn around. But as soon as I take the shrouded armour of, they act normally. Why is this happening?

Before you ask, it is not a mod problem.