Dunmer that are likely fed up with the houses, or got nailed badly after a house war. After all, crossing boarders and moving to different places was a helluva lot easier than in previous times, where going into another country could mean death.
Also, then empire would frown upon killing people moving around country to country.