My karma is neutral and when I go and talk to her she calls me an [censored] and goes through with that dialog. WTF I thought she got angry when you are evil not neutral.
I think your karma may still show as neutral if it's in the low negatives. You don't actually see your "karma points".
Kill a couple of Ghouls or Fiends, get a positive karma, talk to her.