Punched a merchant woman. Suddenly everyone was armed and running after me everywhere. Guards wouldn't tell me to stop even though I was unarmed and not attacking. Everyone was just trying to kill me.

This isn't the first time this has happened, both times in Riften. What gives?

Go to the gate of riften, punch a guard, then surrender and pay the fine. This will clear any aggression.