Do they work together? I vaguely remember alpha masking getting added to OR and then removed again.

Detailed Terrain used to be on Oblivion Reloaded's list of recommended mods but it's been removed. Draw from that what you will.