Or turn off the HUD completely... much better option imo. Been playing HUDless the last 10 hours and loving it.
I don't like that option because then you have no clue how close to death you are. That meter shouldn't break immersion or anything, it actually makes some sense: that's just how close to death your character is, something that you should be aware of if you are your character. Likewise, you know if your stamina is low, or your "concentration" (Or magika, in this case).
So I don't think that really matters too much.
Plus, people in medieval times paid much more attention to what direction "north" was, so it's only natural that you would know what compass direction you are looking at when you are outdoors (though I think that some game should make this change if you are in a dungeon or in a fight, as if you have lost your bearings)