They appeared in Tribunal, too, and the Rieklings are probably relatives of theirs.
A lot of people like the idea that they're degenerated elves; the Cyrodiilic goblins being fallen Ayleids, the Rieklings being fallen Snow Elves (though the latter doesn't work well at all, with Skyrim, what with the Betrayed Falmer). Something to do with Mer without Towers.
Me, I take them as one of Tamriel's many 'beast' races, outside of the Man/Mer dynamic. If they are Merrish at all, I'd say that they're closer to the Orcs than anything else. They definitely have some sort of kinship, what with the inclusion of goblins in Orsinium, and their similar situations before the Orcs were accepted as people rather than animals.