My last character, I turned off radio freedom with no bad effects (though I didn't play very much longer with that character) but then every time I'd run into Preston, he'd say something like "We've been trying to reach you on the radio! Settlement such and such needs your help!" and there would come the load of quests again.
And don't listen to it on your pipboy either......
I highly doubt that it really makes a difference. I got the attacks well before I even established the radio. Might stop the kidnappings at Abernathy's though.
my solution: just never go back to the Castle! Works like a champ!
Except when they get attacked.
And Preston, he is walking the beat on south end of my Island. if I want to help, I will go find him.