I've been trying to get enemies to fight each other instead of me, using variants of a couple custom spells suggested on the UESP wiki. They look something like:

Invisibility on Self for 10 seconds
Command Creature on Target for 3 seconds
Command Humanoid on Target 3 Seconds

or...

Invisibility on Self for 10 seconds
Frenzy on Target for 10 seconds, in a 10 yard area

... but whenever I case either of these, I just turn invisible and the enemies just stand around dumbly, either wandering away or staring as if waiting for me to become visible again. Am I not commanding the creatures for long enough to actually encourage them to fight? Do I need a greater range on Frenzy, or need enemies to be standing nearer to one another when I cast it? Or am I missing something entirely?

Thanks for input in advance.

Are you actually hitting one of the targets with the Frenzy spell?

I'm playing a modded version, but when I hit even one target with a Frenzy spell, they turn red and immediately begin attacking the nearest enemy. It helps if I am far away from them.

When I hit one with Command creature, they turn blue. 3 seconds is too short IMO.

As long as the level of the creature is not higher than the affected level indicated by the spell description, it should have an immediate effect.

Command creature/humanoid can be stunningly effective at getting your foes to kill each other off.

I suspect your problem may be that the magnitude of your spell is too low. Don't forget to account for any efficiency loss due to armor and that you will need 100% spell effectiveness and max magnitude for your mind control spells to be effective on enemies once they get to around level 25. More info here: http://www.uesp.net/wiki/Oblivion:Magical_Effects#Magnitude_to_Level_Conversion

Ohhhh I think I'm dumb. I've got it set to 25 magnitude, but I'm level 26, and I sometimes hold a shield. Never seen anybody turn blue/red upon using these spells, so they're probably not even activating at all. Do they need to actually hit a person to activate, or can you just throw it at the ground between your targets?

I'll try doing this without the shield and with a longer duration. Thanks for the tips.

You don't need much duration, but at your level you can't have any armor at all. Yes, you have to aim at the target.

With Command, you only need to hit one of the group. A fight will immediately break out between that person and the others.

I'm not certain, but it would make sense if a Command spell with an area effect would turn ALL the enemies in range to your side, and they still wouldn't want to attack each other. It's going to work best as a single-target spell to establish an alternate focus for the others to attack.

In Fort Nike, I think, the one with the big water pit, gates and catwalks with chest at their ends. You can trick the NPCs into killing each other by sneaking on to the catwalk and shooting at the group on the other side.

I would go to the obelisks in SI, frenzy every knight, and use invisibility. Once i'm out of combat, they kill eachother,