The battle music is very problematic for me in Morrowind. I tend to fly around pretty fast and it continually pops in and out complete with bleeps when tracks change. It's very irritating and I don't think the game handles it well at all. So I was wondering if there was a way to improve this or simply turn off battle music altogether. I've searched for mods, but it's all just massive overhaul and replacement packs. I need a simple fix here, lol.

Try removing the tracks from the battle music folder.

Hmm, that's a thought, but I still get the blip and then it switches to another explore track.

Try FPS Optimizer, it has "Disable explore<->battle music interruption". I haven't tested it personally, though.