The better player typically avoids getting hit in the first place. So i always find that my light armor skill is always very low. Not saying i have a better solution, just find it odd.
Also lets be honest: Skyrim does not have a dodging mechanic , unless you use the block perk (which i can't use as a dual swordsman
) But even so its not hard to avoid getting hit if you plan things accordingly.
PS:
Offtopic, but i dont want to spam the forum with threads: How does one figure out swing speed? Is it tied to the weight of the weapon? (ironsword is faster than dragonbone?)