In a interview (With GI I believe?) Todd Howard said there was something like 289 perks in the game (at that time) if you included each tier of the "tiered" perks (as in the mace when to ignore X% of armor). That would mean roughly 18 perks per skill. Now at first you may think "ah crap! I won't even be able to completely perk out all my 'stealth' skills." But if you take the combat skills as an example each skill's perks will be like paths. So, you will really only want 6 of those perks most likely. (No point in speccing maces if you already did swords)
I wouldn't be too worried about it.
Edit* Found it! It was the GI podcast.
Within each of these skills, there are perks. They're perks, but they're not like Fallout, in that each skill has its own perk tree.
[...]
And I think the game right now has like 280 perks if you include the ranks. So even a character that raises all their skills to 100, and they're playing and they're level 50, they've only gotten to pick 50 perks. They're very different characters. And a lot of the power is in the perks as opposed to the raw number of the skill. There's still some power in the raw number of the skill, just not as much as there used to be. All that stuff has been moved into the perks.
A thing to note, you get 50 perks not 49.