do what you think is best for you.
Wait until you get to a high enough level for Thalmor to wear it (I think it's level 40) or do power smithing to get it early.
I would gradually work My way to Glass as I play. Glass Armor is not that common for a Loot Drop in the Game, compared to other equivalent Heavy Armors. Glass just takes a long time to show up in the Game
I think smithing is a good option. Even though it's on the other side of the tree, taking the dwarven perk and cleaning out a ruin or two will get you right up where you need to be for glass