As I understand it, humans and elves are both decended from the Ehlnofey, Et'ada too depleted from the creation of Mundus to return to Aethereus. These Ehlnofey procreated to continue their existance, and through decent became humans and elves. Those Ehlnofey who "wandered" in Yokuda, Akavir, and Atmora became humans, and those who "settled" in Tamriel became elves.