Were you doing all the killing while sneaking? I noticed that once, on Fortification Hill, even with Boone tagging along, when I killed all the Legion peons on the way to Caesar while crouched/sneaking, I guess there weren't any witnesses left to my carnage so I hadn't reached Vilified again/Failed the quest yet. I might have been able to leave Boone outside the tent or the area before it, and gone in and talked to Caesar, but I wasn't in a talking mood.
Then again, if I had tried, maybe they would've attacked anyway. I didn't actually test it.