Actually you should first throw your items on the floor (near the display case of course).
Exit your house, re-enter and place your weapon in those cases. This time your items will stay.
To place an item in a display case:
1. Open the display case.
2. Drop the item.
3. Look at the item, and hold down the select/activate button. The item will now float in front of your camera. (You can release the activate button)
4. Move the item to the display case you'd it to be stored in. Position it to your liking.
5. Press the activate button again.
-----------------
Before you put an item in there, you should read the wiki or uesp, because some of the display cases don't really function properly with certain weapons.
You should even make a save before you put something in there, only for the reason that something goes wrong. !!!!
Thanks...I'll give it a try..I've used up all my weapon racks!