And for someone with the game already installed? Would it actually be okay to just rename the current fallout 3 folder and install a new game in the same directory?
That is exactly what I was saying. Use the same 'old' folder name when you install the second time.
Default game folder:
\Fallout 3\
Rename it to
\Fallout Old1\
Then Reinstall (you may have to 'uninstall' first, but that will not be a problem since you have already renamed the game folder)
Now you have two game folders:
Working folder will be called:
\Fallout 3\
And the non-working can be:
\Fallout Old1\
Then rename \Fallout 3\ to something unique like \Fallout Old2\, and rename the \Fallout Old1\ to \Fallout 3\