I have lots of ambient music I think would make good exploration music.. can I simply copy them into the music/explore folder?

Yes.