by using means to fast travel, aka boats, horses, mages guild teleportation services, teleportation skills (spell or perk), carriages, then i would agree with you.
My character won't have the means to fast travel. My character will probably travel by foot most of the time. I, however, will probably use fast travel. The reason fast travel cannot be a role-playing choice is that the character, the role, has no concept of fast travel. It does not exist to him, so it cannot be his choice to use it. He only travels normally, whatever the player chooses to do.