If two different mods place a few items in the same vanilla cell, is the mod that is loaded last going to override the entire cell? Or will the two mods be merged as long as the editor id's of the items are different?

They should be merged, and both mod's items will be placed in the cell.

Thanks. That's the answer I was hoping for