It won't let me get an animal to follow me it always says that I already have one but I don't

Are you on PC or XBox/PS#?

If on the PC, open the console and type: set playeranimalcount to 0

If on the console, I don't know, try buying and then dismissing a dog from the Markarth stables, then try to get whichever animal you want.