Skillbooks are permanent, but they are rarer.
Edit: Usually a +1 increase as in Fallout 3.
Skill mags are temperory and work like the various stims (except no addicition) They are more plentiful and good for when you need a quick boost.
Edit: Mags tend to give a +10 increase. So short term they're more useful.