What about a light and agile swordsman who dodges strikes rather than blocks? He wouldn't get a staggering perk, so it doesn't apply to him.
He would likely get dodging perks. If you're dodging, the goal is to avoid getting hit, and avoiding hits would negate staggering. Just as long as the game avoids stagger-locks for those moments you do get hit (fscking clanfears..).
how about dodge?
Light-armor perk.
Getting one perk that makes you go from svcky to awesome at not getting staggered vs improving a statistic little by little that reduces staggering.
Some perks can be levelled, so they can be selected multiple times to get better with it.