Do they have to stay in your inventory or can you sell them and store them and still get the bonuses?

You can toss them out as soon as you get them and still retain the perk.

But you can display the bobbleheads on your bobblehead stand

and the magazines go in your magazine rack/stand

simple

I didn't know this! What section are they under in the building menu?

furniture.

Thanks a lot