Playing a Stealth Archer that uses poisons is my current character. I have played several archers and I can tell you that you don't need to worry with any armor perks. In fact, even for rogues and warriors, armor perks are not needed.
Only invest 1/5 in Stealth and go up the right side for extra bow damage. Get the dagger perk if you want to kill silently to support your 1H skill. The left side does hold muffle, but it's not worth the perks spent to get it. The spell from the Alteration school or the boots that you enchant yourself will grant the same complete silent value of 1.0 for your character.
Alchemy you only need to invest for poisons, obviously.
Archery only needs 5/5 Overdraw and enough to get 1/2 of Steady Hand.
Block? IDK... Like Ashley says... they will seldom get close enough to need it. Then chances are you won't be blocking enough to advance the skill anyway.
Smithing as needed for your target equipment, I end up getting all of them the left for armor and the right side for the stronger bows.
Enchanting's investment is good enough with 3/5 in Enchanter and run up the middle.
The same with 1H. 5/5 and run up to Savage Strike. Although, you can get training, a stealth archer is rarely detected once you advance the Stealth skill enough. And sneak attacks will advance it faster than anything else. Essentially, you are a sniper, for the most part.
Stamina is not needed for any character. Skyrim doesn't implement the attribute properly. The 100 you start wit can easily sprint you out of sticky situations and you start with a generous amount of 300 for carry weight.
Alteration is a good support skill for a Stealth Archer with Muffle and Detect Life. You don't even need to invest in the skill or Magicka, really. Unless you want to.
OH... I forgot Illusion. Invest as needed in the skill and magicka to effectively cast the Invisibility spell. Otherwise, if focusing on the other Illusion spells, you need to be fully devoted to the school as it's an all or nothing type of skill, to remain effective for the other spells.