Do perks stop at level 50 or can you keep levelling up and acquiring perks until you are a power house of the commonwealth?

You can keep leveling, there is no cap. But the xp requirements get bigger too, so will take quite awhile

so I can get all the perks?

Eventually, yes, though I'm not sure if there is even that much XP in the game.

It takes at least around 80 levels to get the perks available to you with only 28 SPECIAL points. Then there's the Bobbleheads and +1 Special book.

You know, I've been saying that Idiot Savant is useless, but it might actually shine since there's no level cap.