And the guy would kill him in two hits. Just two hits, in every attempt. It's insane. (And I was only playing on expert)
I somehow managed with the help of the Dragonborn ghost that spawns from you when you're getting beaten but that wasn't the victory I wanted.