Bosmer have always had a bestial component to them. Have a look at http://www.imperial-library.info/sites/default/files/pge01_aldmeri_pic_02.jpg illustrations from the first pocket guide.
It's also a component of the wild hunt, a ritual that causes Bosmer to transform into monsters in large numbers when Y'ffre wills it. The antlers are not exactly a manifestation of this, but a sign of the same principle. In Khajiit myth (and Bosmer ones, which I think have more of an appearance in ESO) the Bosmer are the result of being fixed into elves in the Dawn Era. There is variation among the Bosmer in how "elven" they look, with some having more animal-like features.