Maybe my memory is a bit hazy but i recall taking endless beatings in Oblivion and Morrowind trying to walk fom one location to another, regardless of the route, and especially off-road.
I've walked about a 1/4 of the Skyrim map so far in relative safety. There has been the ocassional encounter where i've got my ass kicked but i'm surprised how easy walking and off-road walking is.