Imagine if... the accuracy of the compass was tied to a survival skill and/or perk(s). Whenever you change direction, the compass would only move exactly true if you had perfect directional ability. In this way, as you level up (and explore the map), you will get better at finding your way around.
Also, during bad weather conditions (rain, snowstorm, blizzard, fog, evil locusts) the accuracy would be lowered even more. Following the compass could actually lead you astray.
Thoughts? Opinions?