It's an interesting idea. Could you quote the bit you think points to goblins, though? I don't see it.
I'll hesitantly assert that http://www.imperial-library.info/content/morrowind-wild-elves does not support your theory, though. As far as I know there's no clear date of when that was written in-character, but we can assume it was after 2E 227. No telling how long after, but I'll postulate only a few hundred years. Maybe it's misled, but I feel that information on Ayleids would not be as carefully preserved as other knowledge in Imperial libraries, so it would have to be fairly soon for the author to have access to the records of that Ayleid and his writings. Furthermore, the elf in that text lived about three hundred and fifty years - obviously, we don't know how he died, whether that was a typical lifespan or not, but still, we know that Ayleids in good care live
at least three hundred years. So it doesn't seem like there was enough time between 2E 227 and 3E 433 for a long lived group of elves to blend indistinguishably with the goblins of Cyrodiil.
I'm not saying it's impossible, just that there's no evidence. (Although from your title, you already know that.)This is TES, after all. Some Aedra or Daedra could have bloody well cursed the remaining Ayleids, akin to that of the Dunmer, or something like to the change of the Orsimer.