UP being underpowered.

Okay so, I'm current playing a Nord Warrior. (Oooooh how original, before you say it, yeah. I know) I'm at level 28 playing on expert, mainly because I like common enemies to take more than a a few strikes to take down. My character is a "hybrid". I've been using a vast array of all the warrior skills, plus a few levels in Alchemy and Enchanting. Basically I use light armor when I travel, since I don't use FT, and don heavy Armor when I'm exploring dungeons.
I make ample use of one handed, block, two handed and archery. Now, all my of my weapon skills are at or about 50, but both my armor skills are lagging behind at about 38.
My main question is, will this lead to being underpowered? I just went into a bandit lair and a bandit marauder took me out (while decked in HA) with one arrow and a slash of her one handed blade. Is this normal on expert? I'm wearing a modded armor set, but it's not pretty much steel upgraded to flawless.
I've noticed that in all my play throughs, armor skills level slowly because I "dodge" incoming blows. Is this kind of damage taken normal on expert? I like using all the warrior skills because I don't feel limited and it makes things more fun. I've also made sure I distributed my perks equally.

Perhaps you should first specialize in one type of armor before moving to the next. Or use a mix of them, like light boots and helmets while using heavy shield and armor.
In some point you will be underpowered I think, as you will rise many levels and also the enemies will, but them will have more skills in a single thing.
Other option is to specialize in light armor and block first, so you can perk the blocking to deflect arrrows and help you in the fight.