Is there a toggle to disable that glow? It's annoying as hell trying to talk to people and they're all glowing. It's useful in combat but I don't want it on all the time.

Nope, and when you take it off then you got no head lamp, wish there was a way to use the pip boy light with no power helmet.