So, how exactly would I go about installing them? I have no experience with this kind of thing.
Depends on what type of mods. Going to the Mod forum here will help you.
But the rule of thumb is everything goes into the \Oblivion\Data folder. If they contain sounds, textures, meshes, or anything else then the author of the mod will usually have them already sorted into their individual folders.
.esp and .esm files go directly in the Oblivion\Data folder.
Then you either use the default Data Files section in the launcher of the game or use a Mod Manager to sort and check the files to be loaded in the game.