The UESP Wiki says:
Agility - Affects your total Fatigue, damage dealt by ranged weapons, and your steadiness in combat.

Does Agility affect damage dealt by magic attacks? A staff is a ranged weapon. Or does this only apply to Bows?

The damage statement applies only to bows regardless of how it may sound.

Thanks! That makes sense.