If the player gives him his/her weapons and ammo, the Overseer will turn hostile and attempt to attack, regardless of whether or not the player had any at the time (e.g. they left them in a desk). The Overseer may try to find a weapon if that happens to be the case, but the player can beat him to where he's going. The Overseer will continue to attack after that, albeit with his fists.