Does the level-up menu actually do anything besides advancing me to the next level? I get to pick what attributes I want but all they do is reset only a few seconds later.

You don't get to pick attributes with Realistic Levelling. It's automatic, determined solely by the skills used according to the formula in the mod. The levelling menu should only have the option to click. OK.

That's what I thought. Thanks for the clarification.