It sounds a little too "nintendo" for me. Sometimes a bandit hideout is just a bandit hide out.

This. Even in Nehrim I clearly remember this one tiny cave that had just one bandit guy and his three dogs near a small underground pool. No '+8 Destruction Gauntlets' lying around anywhere. And you know what - it didn't matter, because the cave felt like a place a real outlaw might actually inhabit.