I am going to make a sniping build that does not rely heavuly on VATS am going to need a lot of agility? or just enough for perks?

Well it might depend on what weapon your using but I'd say just enough for perks.
Be sure to plan out your perk list. You don't want to reach level 16 and realize you don't have enough perception for better criticals.

Sniping with vats is bad anyway, just get 5 agility and an implant to get it to 6 for perks.

For a Guns character, I usually put 7 in Agility, even though I don't use VATS. It benefits Sneak as well as Guns, so it makes sense for a sniper character.

Most gun characters I take between 6 - 8 agility my main focus of the build and never really dump stats apart for specific roles.
Then I add small frame for the +1 ag and effects on limbs ( as I rarly sneak anymore ).
It effects reloads, movement, skill I'm not sure about RoF but I doubt it.
When combined with perks and traits like fast shot, and rapid reload it really makes the difference.

Focus on meeting the skill and ST requirements for your guns so you have minimal sway when aiming. I would have ST at 6, since that's the most you'll need for any rifle (except the anti-materiel rifle, but the Weapon Handling perk takes that down to 6 as well). As for AG, take it to 6 if you want the Light Step and/or Silent Running perks, but otherwise it's unnecessary since accuracy perks like Sniper and Commando only affect VATS.