If I press M to bring up my map I'd really to press M again to close it - and with all other things that open with one press but need another to exit.

It's really annoying.

Well, if something opens then the same key must be pressed to close it again.

I thing you should try a gaming controller! It works much easier on those situations.