I use an xbox one controller, and on the map I can't move the pointer up or down. It starts off at the very top off the map and can only move across, strangely though if I manage to get it over a settlement I cannot fast travel either. whcih is my biggest issue.
It does work however if I use a keyboard and mouse and turn the controller off. But my prefferences is with the controller.
Also just to note my only other problem is the lockpick glitch and not seeing the lock.