Distance weapons, my dear, distance weapons.
I make "Slow" poison out of deathbells and salt, it lasts quite a while & gives you a better chance. "Paralyze" poison (canis root & imp stool or swamp fungal pod) doesn't last very long, so you'll need to carry a few if you go that route. "Paralyze" weapons don't always work, whereas poison always works on giants.
Anyway, conjure up an atronach to help, use poison on your weapon, & take him out with arrows. You can also take him down with magic, I like to use fireball or Ice storm.