Neutral/Unknown is not a reputation you can maintain in F:NV unless you avoid doing contentious things. There are actually two separate reputation axes for each group/area: Fame and Infamy. If you do things that help the group, you get Fame. If you harm the group, you get Infamy. The relationship of these two scores determines your overall reputation. So if you do a bunch of good and bad things, you aren't unknown; you have a mixed reputation.
This was done specifically to avoid the feeling that your actions "wash out".
Makes a lot of sense. So instead of getting a blank slate for killing some people in a town after saving them, they're just like, "Who in se hell are you!?!?!"