Yes the issue is lack of restraint, but it does literally hinder my experience playing the game.
*not spoiler but caution reading below*
I mean who doesn't want to toggle collision instead of going around the mountain, or adding 4000 "F" to fully furnish my home?