One limitation to consider using dispel defensively is that it only dispels magic effects inflicted upon you by spells. Not from poisons, staves, magical weapons. greater powers, lesser powers. Of note, almost every critter that uses magic, from wills-o-the-wisp to spriggans to atronachs and spider daedra inflict magic via greater/lesser powers - not spells. So it really only helps versus other mages, goblin shamans and dremora mages - and those foes almost never cast anything on you that lasts more than a few seconds. The problematic and longer lasting effects you would want to dispel generally are inflicted by staves or poisons - and dispel is useless to counter that. For a mage to carry potions or scrolls of dispel sounds like a good idea in case silenced, but the only times my mystic archer has ever been silenced has been by something like the lesser power of a wraith or a staff of silence - and again, dispel is useless there. Practically speaking, the best defense for a silenced mage is to drink a potion of invisibility and slip out of the fight until the silence effect expires. My mystic archer only carries one type of potion (that combines restore health, restore magicka and invisibility).
Using dispel offensively is not impressive either. If you can hit a mage with a dispel spell, then you could have just as easily hit him with a lethal arrow or spell and killed him instead. Dispelling summons is problematic as well, for you have to hit the mage, not his summon - and they are quite adept at hiding behind their summons to preclude that. Even if you do manage to dispel a mages summon, he will simply resummon it. Summons are better countered (by mage characters) by commanding them against their masters or sending them running in fear - in both cases, enemy mages are not bright enough to unsummon or resummon in these circumstances. My character has happily buffed her nails as a goblin shaman's headless zombie kills its master.