Well this is unusual: Unchecking all mods and starting a new game, the problem still persists.
I still doubt it's hardware related, as all my other games are fine, so what could it be?
As I mentioned earlier, everything worked for me also in other games and Windows, just not with Oblivion and OOO. Checking the sound speakers configuration fixed it. But if you checked that and it is set correctly, then you figure the problem is somewhere else. I recall a thread recently with someone having a similar issue (except maybe they had no sound at all). It should be in the first 2-3 pages.