If you get them to leave they actually stay in the city. I don't mind this since there aren't really enough NPC's in the game. But what I can't find out is what do they do. The UESP says they continue their schedule but does their dialogue or anything change at all?

Not that I'm aware of.