So i tried to decorate my home with some loot.. What i tried to do was

1) Put my gems in a kettle i placed on the table
2) Build a "shrine" dedicated to my service in Brotherhood. Including Blade of Woe, the family heirloom, a nightshade flower and a scull
3) Put some herbs in a box
4) Placed 2x Dibella statues with the right falmer eye in between them

(Please note this were on separate tables)

I left the house, went to dissenchant some stuff and went back (Whiterun home) and when i came back, everything was on the floor.. My gems had moved from the kettle to a empty table, dibella statues + Falmer eye were scattered around the fire and i had herbs all over the floor..

Do someone have an explanation on whats going on?

Yap you just can decorate again and everything will stay where you will put it:)
Just drop stuff on the ground then leave home, go for a walk with doggy:) then return and decorate with the stuff you dropped.. kinda works for me

Thank you, finally a working bandaid solution. I've tried everything.

Aha, so first you got to dump the things on the ground. Go outside, go inside, THEN decorate the way you want it and it will stay? THANK YOU for that information.

I don't have any decorating tips, but I highly suggest that you use that Blade of Woe instead of using it at your shrine. If you improve it to Legendary it does more damage than a Daedric Dagger improved to Legendary.

EDIT: I forgot to mention that you don't need an ingot to improve it either. Dunno if it's a bug or what, but there's no ingot cost.