How do I get PG as a companion? Do I have to retake the Castle? He keeps giving me radiant quests and banging on about retaking the Castle, but that's it.

My next main quest is Hunter/Hunted, so I'm a little bit into it.