Hm, yep. Just tested it myself. Even with twin souls perk both get unsummoned when you use a cloak spell. What really makes no sense is if you have elemental potency for your summons to be 50% stronger THEN they don't unsummon, for whatever reason. Go wrap your head around that one.
If you don't have that perk, casting your cloak first is the only way to avoid it then. Weird find.