I just made a new character and noticed when my axe does 17 damage, when i spend a second perk in armsman my damage only goes up two points. Isn't that completely useless?

Not necessarily. Depending on what difficulty you play on, it could make a world of difference.

im on master

The damage increases by percentage, so you won't see a real difference at lower skill levels.