I am getting very annoyed because when i go into the legion fort (i let them take my guns and i have a more than neutral rep) i will get attacked, sometimes instantly, other times in front of caesar's tent. i am wearing no armor, no weapons equipped, and i am able to talk to people, and no Boone. but i dont know why this is happening please help me!!!!

How is your reputation with the Legion? By the sounds of it you have bad rep, and are wearing legion armour, in which case, contact with any high ranking person of that faction will cause everyone around you to attack.