We know the exact nature of a soul has never been uncovered as every mage who has attempted such a thing has seemingly vanished - the reasons for this is another discusion in itself - but we can speculate.
The first question to be answered is:
Is a soul simply the energy that powers a machine or system such as a body, creature, enchanted weapon or the Ingenium (http://www.uesp.net/wiki/Lore:The_Infernal_City/Items#Ingenium). Or is there more to it than that is the soul actually the manifestation of the conscious. Some sources cite tales of beings that could still remain in a state of semi-life ( The Underking for example (http://www.uesp.net/wiki/Lore:Zurin_Arctus)).
It would also seem that a soul is more like water - in the sense that small parts can be taken of it (http://www.imperial-library.info/content/oblivion-souls-black-and-white) - than say a block of stone.
On death unless trapped in someway by soulgem* or other means a soul is supposedly sent to the so called "dreamsleeve" to be "recycled". But souls themselves can interact and talk and in my opinion the soul is like half of a whole, the Ying where the body is the yang.
*Another issue I would like to raise is soulgems. What are they made of as they disentigrate after use and I cannot find any lore on how they are created.