You don't want to keep bound items, because they'll never leave your inventory. They're weightless, sure, but they clutter up your menu. Pretty sure they cause other bugs too.
But if you insist, you need to make an enchanted item with Constant Effect Bound Longsword, Axe, Mace, whatever then just switch between that and another weapon a bunch of times.