It gets easier, eventually. I'm playing @ Master though, not Legendary. Smithing is something you will pretty much need to perk up, I reckon. If your skills aren't sufficient for dealing and absorbing damage, then you'll have to rely on sharper blades and tougher armor.
And, don't fight everything if you don't have to. Sneak past stuff, use invisibility and calm, or Kyne's Peace for angry wildlife.
Of course, you'll get nowhere if you fight nothing at all... just pick your battles wisely and be prepared.
I think Legendary was more intended for people whose characters were already godly and getting bored, but I salute you, OP, for giving it a shot from the get-go.