I imagine that it will be different if I had played the previous games, which I haven't. This character has been retconned whenever I feel like it, which is... Quite a bit. At the present moment, he's integrated into the Summerset Isles/AD vs. Imperial conflict, and is currently on flight from what appears to be a militant totalitarian regime. His family is a scholar, and, since not that much information is given in-game to tell us about Altmers, I made it up.
His clan and all that is unknown, but it is clear that his father was implicated in the Oblivion Crisis due to the Altmeri obsession with ascension to Oblivion, while he himself was expressly forbidden to study Conjuration.
I have a fairly developed Dunmer, too, but he was never integrated into the lore so much as he was a result of the lore; second generation Dunmer of Skyrim, for instance, with a bent to listen to the destructive elements of his blood.