If this makes sense.

This is a progressive bug I've had since the very beginning. Happening only a few times, to now where it is quite pronounced and happening with every battle.

From an immersion perspective, you can't possibly get more immersion breaking than this.

Has anyone else had this problem and know how to fix it?

The world music doesn't stop when the combat music starts. They play together.