To alter how much gold a Merchant can Barter with, you have to edit that in the Construction Set.
Barter amount is a variable in their AI Services listing, so cannot be altered in-game with the console.
it'll give me a random low number like 2400 or something. Is that normal?
Yes, there seems to be a limit to how much gold you can give yourself at once.
Try 5000, that smaller number should function correctly. And then you can repeat the command a few times until you have the amount you want.