I suppose this was done troughout the games from gameplay reasons (not to have a hundrend versions of quarter-quarter), but the explanation given was that a child inherits his mother race. Still, I would assume (or prefer) it's not entirely the case. Jagar tharn, for one, supposedly had some altmer, bosmer, and even human blood, with symmachus being able to recognize that. well.