I don't want to build the house, but I just spoke to Delphine at the riverwood inn, can I store my struiff down there?

http://www.uesp.net/wiki/Skyrim:Sleeping_Giant_Inn

According to this (see under Notes) the containers are safe (except for the barrel).

Somewhat evil? Stealing candy from children and not holding up the door for elders?

And if you feel like being ghetto the wildnerness has no problem keeping your stuff around, even if it has reset.