So the way to get the stolen status removed is-
...some NPC/enemy must pick it up from the floor, then you kill them, and the stolen status of the weapon is removed so you can take it from their corpse. They only pick up weapons if they are on alert state, not if they are in calm state. And you can't reverse pick-pocket the weapon in their inventory and kill them, else weapon still has stolen status.
And NPC only pick up weapons if it is better than the one they have. Even if they don't have ammo for it, they will still pick it up.
Obviously since they don't pick up outfits, this tip is only for getting stolen status of weapons removed, and not apparel.
Some say that fencing to merchants work, but it has never worked for me (I play Xbox version).