You can have charisma/2 companions, rounded down.
For instance, if you have 5 charisma, you must divid it by 2. You will get 2,5 rounded down, which makes two companions.
If you have 10 charisma, you could have 5 companions.
Magnetic Personality can add one slot. (but 5 is still the maximum)
You can also go higher if you already have five companions when you meet some of the companions that force themselves in your party.
(there are a few of them that don't leave you a choice, and will join you regardless your party. But they are amongs the weakest)
Also, having 1 charisma will means that you will generally treated as a joke or so ugly that people wouldn't even want to talk with you. And don't even think of seducing anyone. I also believe it could reduce some dialogs option, for the npc that will accept to talk with you.
Also, if the potential companions refuse to join you because you don't have enough followers slots availables, they will say it to you.
They would say something like "You are too many." Or at least say will refuse to join you if there is another factor.
It is very weird that you don't have the option.
Did you tried to speak to them more than once ? (i believe i had to talk to Sulick twice on a previous playthrough)