And besides, the sources don't claim that the worst of abuses were institutionalized throughout the whole of Cyrodiil. Imperium Saliache was a collection of city states, after all, and possibly as diverse as the human tribes they enslaved.
If it's anyone's fault, it's the Nords who ravaged the North and caused the repressions (against non-Atmorans) in the South to begin with.