Sorry, I didn't really make it clear what I meant. I meant that if it interferes with the things that I'd want to do, such as questing and dungeon diving, it wouldn't be worth it. I know I'm probably going to hear the " it'd just be an option! " comment for posting that but oh well. Fast travel is an option to, if you don't use it then you feel gimped in a way because you know there's a way to get to your destination quicker and get that annoying quest over with. Although, if you use it, you could be missing out on some random encounters ( there will be tons of them in Skyrim ) and nice loot, also you'd feel like you were not getting the experience a player who didn't use it would get.
So yeah, as long as the job can be done without wasting too much time I'd definitely get in on that.