Summerset Isles and Valenwood and Pyandonea are down in the south west and far away from Morrowind, why is it Morrowind (or was, after the red mountain exploded

Why not settle in Elsweyr or other places close to the other elves?
Was there some sort of an 'exodus' or a great journey or something? Did they originate in Morrowind? (that is, not connect at least species-wise to the other elves?)? etc. etc.?