The game stops responding to my keyboard or mouse after a few minutes, this usually happens when I open the pause menu.

Might be a codec issue. It was a common source of cause in the past for input devicing cutting out after a few minutes. Give K-Lite's Codec Pack a shot.