I don't know if it matters but:
When i enter the town, i always have to fight with the guards from the bar/casino on the east side (in the west side of the town). I once tried pickpocketing a guard but got caught and have been hostle with them ever since.
Thanks in advance, Adrian.