However, at the same time, the game world is also too small to make your ideas very reasonable. It really does not take very long to travel from Skingrad to Anvil. You'll likely never even need to stop.
If you never allow fast-travel, I assure you, it would get VERY boring walking down that road for the umpteenth time. There does need to be an option to skip the trip. But Oblivion's was not the answer, and I, myself, after a long time of no fast travel at all, eventually caved to the tedium and created this new system for myself:
-I can only fast-travel once per day.
-I can only fast-travel while on horseback.
-I can only fast-travel to cities, stables, settlements with inns, or player-owned homes.
See what I did there? Not only did I give the game's inns more purpose, but I also did the same for horses. Now I have a reason to own my horse, and I also have a reason to visit inns (aside from the fact that I also simulate primary needs while in the world, giving inns a whole lot more purpose right then and there). Why remove a component entirely when you can simply tweak it to encourage the use of other components?
Thats...A great idea, limiting fast travel to inns is a good way to do it