Hello Everybody.
When you actually fight Dremoras and you get to banish them ( As they cannot die ) why is there still a physical body of them ?

Yep. Whatever husk they're using remains, but their soul is recycled, iirc.