I am not sure if Ayleids should be marked as extinct, sure their culture is no more, but some of their descendants live on as wild elves and some interbreeded with bosmer.
Culture is the most important factor here, since the races don't vary in appearance all that much. I've compromised by leaving the Ayleids (as in the Heartland High Elves) extinct, but adding a branch onto them for Wild Elves (modern "Ayleids," which do not share their ancestor's culture).
Aren't the Direnni just a family? http://www.uesp.net/wiki/Lore:A_History_of_Daggerfall
And I thought Bretons were the result of intermingling elves and Nedes. http://www.uesp.net/wiki/Lore:Frontier,_Conquest (That book also mentions Atmorans as simply being Nedes...)
I'm using Direnni to describe the branch of elves that stayed around Highrock after the convention. I'm sure there were more than just that one family, but we don't have a better name for them.
Atmorans are from Atmora. Nedes are the natives of Tamriel. Some of the older lore calls all Merethic Era men (incl. Nords who came over before 1E68) "Nedes," but this isn't correct in the modern view of things.
Updated graph up.