Hmm, I know that in black widow spiders, the females can be much larger than the males... and they also try to eat the males after mating
Maybe the bosmer men have to be small so they can get away before their lady gets hungry?
I can't think of any occurrence where primates, or any other mammal, where the females are always significantly larger than the males.