So, it appears that any worn headgear (hats, helmets, glasses, wraps, masks, etc.) receives no damage at all in combat unless its equipment slot mask includes either the "head" or "hair" slot.
Probably a leftover from Oblivion which only had those two slots usable without tricks.
Is there any kind of fix or workaround for this?