I got both of mine recently. I am almost positive that the gems (and flawless gems) are leveled loot because I didn't see the first one til after level 35 and I have had the quest for 10 levels now.
According to the wiki, it takes 20 days for the one in the Temple of Dibella to respawn...standing outside of the inner sanctum and waiting 20 days counts, right?