This can be confirmed in my eyes by the Ayleid pieces of armor we find in certain quests as they look identical.
What happened to them. According to TES lore many were exiled to Valenwood.
http://www.uesp.net/wiki/Lore:Ayleids
"Ayleids, also known as the Ancient Ones, Wild Elves, or Heartland High Elves, were the first race to establish an empire in Tamriel. They were the original founders of the Imperial City, although it was a fortress called White Gold Tower in those days. They spoke a language now referred to as "Ayleidoon", a derivative of Aldmeris which was once the language of the human Cyrodils as well. Much like the lost Dwemer (whose ruins can be found in Hammerfell and Morrowind), many Ayleid ruins can be found in Cyrodiil."
"Ayleid culture lingered in the city-states that survived as client kingdoms of Alessian Cyrodiil, but the Elven population was finally driven into exile (largely to Valenwood)[7] by the intolerance of the Alessian Order."
Is it possible if not obvious that the smaller evolved Bosmer of Valenwood are in fact the descendants of the Ayleids (Wild Elves) seeking refuge in the forests of Valenwood?