Like so many dungeons in the game, Silorn has some unique features.
In that dungeon, you need to go from the 1st zone to the 2nd, and then back to the 1st at a different entry point (on a balcony). The switch to that gate is on that balcony. After you press it, you can jump down, go through the opened gate and into the third level from the 1st.
Recommend try going through the second zone and then back to the first at C(Z2) on this map:
http://www.uesp.net/wiki/File:OB-Map-Silorn.jpg
http://www.uesp.net/wiki/Oblivion:Silorn