When I'm the host, the framerate decreases significantly. It becomes unplayable at times.

It goes way below 20fps at times and it happens a lot.