I know that this is an old thread, but I haven't been able to find a better one, so I'm hoping someone is still watching this one.
I'm playing Oblivion GOTY Edition from Steam, using OBSE through the obse_steam_loader.dll. My PC is built on a Intel Core 2 Quad, with 4GB of RAM and a NVidia GTS250 GPU w/1GB of VRAM. I've built up a collection of pretty heavy mods, including Bananasplit Better Cities, Unique Landscapes, QTP3 Redemized, COBL, Frans (w/ extras), Supreme Magicka, and others. I've got the whole pile pretty stable using Wrye Bash, BOSS, and OBMM's Archive Invalidation. The only remaining issue is the total memory requirements.
I've followed the advice on the first post and watched my memory usage while playing in windowed mode. My CTDs are always on load of a new cell or transition on a door, and they always correlate to a memory jump to around 1.8GB.
I'm using OSR 4.1.24, with Threadheap3 replacing the standard heap and 1024 MB preallocated. This makes my load times pretty quick, and stability has been good except for the memory limit CTD.
I'm a software developer, so I don't need a lot of handholding with regard to issues like the 2GB problem. I've set the LAA flag on Oblivion.exe, obse_loader.exe, oblivion_steam_loader.dll, and even on steam.exe and Steam's GameOverlayUI.exe. None of them ever "take". On every load of the game, my obse_steam_loader.txt in the Oblivion directory always reads:
clearing large-address-aware flag (flags offset = 0000011E checksum offset = 00000160)
crc = A2408F04
dll = c:\program files (x86)\steam\steamapps\common\oblivion\obse_1_2_416.dll
Nothing I've tried has prevented obse_steam_loader from clearing my LAA flag, and that message is honest, because the 2GB limit is clearly still in force. I've never gotten Oblivion above 1.8GB without a CTD.
Any advice, or must I just put Streamline into its most aggressive memory purging mode all the time and hope that it keeps me below 1.8GB?