If they did implement this into the game, it would have to be developed extremely well. Like not being allowed in the mage's guild (or being kicked out if they saw you use any spells of the kind), and people should probably have lower dispositions with you if they see you summon flesh golems.
This, while not making it super OP but still advantageous to use given the negative effects of being 'caught' using it. There could be quest lines dealing with a split in the conjuration college or a mix of several colleges middle-upper members who break apart and form their own sinister sect in the wilds.
Of course being associated with the will make most people ill and not want to speak with the character.