Yeah pretty much.
Speed wise, swords are the fastest, followed by axes and then hammers.
Perks wise, swords get better critical chance, axes get more bleeding damage, while hammers get better armor penetration (i think).
So, it comes down to what your style is IMO.