I highly doubt that. You build towns in the game so a high charisma stat will likely affect how fast people come in to settle and how willing people are to start working for you either as merchants or guarding the town. They might be more likely to leave if the town is attacked and you can't convince them to stay (low charisma stat) etc. etc..

The perception affects weapon accuracy in vats. Agility affects your action points and ability to sneak. So ALL SPECIAL attributes are important now.