I was messing around with different thing to try and get the game more stable and I finally found something that helped.
Disabling Steam Cloud Sync helped me a lot, I used to crash every 15 minutes and I haven't had a crash or hangup in over an hour.