FWIW I keep them all active, every single one. I find it helps when I am traveling around and looking at the map- it is like "oh- I can do 5 things while I am here!" Otherwise I would keep forgetting quests and wasting my time going to towns over and over.
But you could think of changing that mindset if, at the same time, the ridiculous amount of active quests bothers you.

I mostly don't get many quests at once at all. (Mostly though because I roleplay a character who usually is pretty strict at what he does at all; not so much to do in the game for one character like this.) Try making mental notes instead of keeping all the quests active. Think, "what should I do when I visit Solitude next" and the like. And even if you forget something... well, does it really matter? You can surely go back to that city (and fast in IRL time too, with fast travel) and finish your remaining jobs there later.
I sometimes rush through an Elder Scrolls game for apparently no reason as well. Lately I've tried to settle down, explain to myself that everything in the game waits for me and I have no real hurry anywhere. There's actually more gaming time and less stress to be achieved if you play slowly and non-systematically!
