You also need to complete the Brotherhood quest Blind Betrayal before you can max him out and get the perk. Have you done that?
As I recall it's before the point of no return for the BOS with regards to the Railroad. As long as you don't report to Captain Kells, you should be fine. Save fore handing in Blind Betrayal just in case.
I wish you could have gotten that perk before that quest.