I think this is true, it's not YOUR house, but it is a safe place to stay and they let you use anything there, dunno if the containers respawn there though.
Correct me if I'm wrong, but in Oblivion didn't you have to attain some level of fame to even buy the waterside shack in Imperial city? I remember the option to buy the shack is not immediately available anyway.