I believe that the named chests; Teinaava's chest, Gogron's chest etc. are the only non respawning containers.
But wouldn't they take anything in there? I mean, put Dawnfire in Gogron's chest. Would he end up weilding it because his AI tells him "Look! Shiny new and powerful sword! Use it!"