I am on sneak rank 4 and pretty much i can walk right up to people now. They still know where you are if you have a companion running around with you or if you shoot them from a distance. Sneaking on rank 4 is not a 100% guarantee that you won't get noticed, but I feel like its a really nice middle ground.