I joined the legion and decided to leave it for a while after the battle for Whiterun. It's actually been ages.

I've just discovered a fort that I know from previous games had bandits in it but now it's got legion troops.

I vaguely remember the legion campaign from the first time I played it. I wasn't really impressed, it seemed to be capturing forts and very little else. But I don't want to miss out on it either. So by leaving it am I missing it? Are the empire capturing forts without me?

Thanks guys.

Nothing happens until the dragonborn moves his/her dragon butt.

I wish it did go on without me though....then I wouldn't have to do those capture the fort quests.

If you ask me that's how it should've been done, we shouldn't have even been allowed to join in.

As others have said, you have nothing to worry about; just come back to the CW quests when you feel like it, nothing will happen without you.