The most important document regarding this is the http://www.imperial-library.info/content/nu-mantia-intercept

Towers and their stone:
Built by Gods
1st: Ada-Mantia/Adamantium Tower/Direnni Tower/Ur Tower and its Zero Stone.
2nd: Red Tower/Red Mountain/Dagoth Ur/Vvardenfell and the Heart of Lorkhan.
Built by Aldmeri
Crystal-like-Law/Crystal Tower
White-Gold/Imperial Palace and the Chim-el Adabal/Amulet of Kings
Orichalc
Green-Sap
Walk-Brass/Numidium and the Totem of Tiber Septim
Snow Throat/Throat of the World
and on and on....
Possibly the Ceporah Tower from the Isle of Artaeum?
There is a theory that the Khajiit themselves could be a tower, and moon sugar is their stone.

We should remember that the Tower is an important symbol in Elder Scrolls iconography. It has mythical importance and great metaphysical power. Vekh http://www.imperial-library.info/content/tower of it, and it is an important part of the http://www.imperial-library.info/content/concerning-psijic-order-and-psijic-endeavor

The anticipation of Talos.
What is Talos but a tower turned sideways?

Snow-Throat was built by the elves?

Its really unknown.
Because every tower 'known' is built by elves, inference dictates that Snow-Throat is as well.
Therefore it is again inferred that the Falmer are responsible, I have read speculations about the 'left eye of the Falmer' but that sounds wholly too convenient to me.
Minding that the existence of these towers is apocryphal and minding that they seem to be merethic not mannish I postulate that Paarthunax is the stone of the Snow-Throat tower.
There isnt really any proof, but its an interesting thought.

It is odd that Vvardenfell should be built by Gods but not Snow-Throat. Perhaps the Falmer did not "build it" in the sense of constructing it but rather "anointed" it as a tower in imitation of Red Tower. Crystal and White-Gold, on the other hand, would have been built in imitation of Ada-Mantia.

As far as I understand, all towers are reflections or imitations of Ada-Mantia in some way.
(Nu-Mantia! Freedom!)
The Red Tower of Vvardenfell is a Dwemer construct first and foremost, they built the Numidium around the Heart.
This may mean that all towers are constructed around a 'stone' of divine origin, and White-Gold with the Amulet of Kings seems to fortify that.

Its all inference but, why not, the Falmer made their tower around a dragon, a living anachronism, an ungradiated Ehlnofey.

Orichalc may not be a creation of the Left-Handed Elves but rather of the Orsimer since Orcish armour is created from Orichalcum ore.

Given only its name, I would guess the same. But I understand that it was constructed on Yokuda, a continent to which, as far as I know, the Orsimer never ventured.

As far as you know.

Perhaps the sinister elves were the aldmer precursers to the orsimer. We just don't know.