Instead of making the store close at the 4th offense, I'd much rather just see the merchant lock all his goods in a cellar/attic/closet at night and start sleeping in a chair infront of the door. But closing the store down for doing what some people have their entire character geared to do? To harsh.
I don't think you'll be limited to one store. It seems like a fundamentally bad idea to rob the same store over and over again. If you were to ransack a weapon store clean, I think that would put one hell of a dent in their business, certainly enough to put them out of business. There should be good stuff to steal this time, but at the same time they need to offer more repercussions, other than "you're under arrest for X amount of time"