is this the same for all magic or just Summoning? Because that is not how it is supposed to work.
AFAIK, it's for everything. Having a good Destruction skill will make your enchanted elemental damage weapons/staves last longer on a given amount of power as they use less charge per strike/use and so on. Perhaps having something to do with how the keyword system works with perks like the Illusion terror perk and Flames synergy and the newly discovered Necromage/Vampire synergy.
Needs some fixing if it's a bug or at least some tweaking if it's a design decision as it's very wonky behavior that seems like it shouldn't work that way at all as you state. At the very least it'll be something that is altered in a modded bugfix of some sort I'm sure.