First off.. I am vilified by the legion...I killed the guy with the big armor and put it on to be disguised. I travel across the water to the fort to look for Benny. They take my guns at the gate, I go up the hill to another gate and when I get in. I get attacked for no reason. Can someone explain to me wheee to find Benny or what exactly I am supposed to do?

At a certain point, he (Caesar) will forgive your crimes and let you in.

But I actually get in.. The guard at the gate said Ceasar was expected me and I used my speech to talk the guard in to letting me take my chems in. But the next gate I go into, I get ambushed with no weapons

Maybe your alloud in the first section of the camp, but the guards recognize you in Caesars part.

Any ideas on what I should do? The map marker is telling me to go back out of the fort. But that makes no sense