i went into an oblivion gate and when i got out...my horse was dead cause i failed to kill the outsiders...i went to town to cash in.....and it said my horse was at the gate...you know....i went out and sure enough my horse was there.....i thought this can't be....so i went back to the gate i just closed, with my horse and sure enough my horse still laid there dead and yet it stood there as alive as can be......after all the horses i lost before i got smart....that was weird....but who isn't going to take a free horse......since then i have never had a horse die on my watch.....and i carry the spells to help....cause horses need some love for all they do

Conversations with the dying.

In the Arcane University's Lustratorium, I was in stealth, and reverse pickpocketed the Mage Apprentice a Poisoned Apple.
The Apprentice sits down in a chair near Julienne Fanis to eat the Poisoned Apple.
While the poison was doing it's job the Apprentice asks Julienne, "A moment of your time fellow Magister"
Julienne replied, "Farewell".
2 seconds later the Apprentice keels over.

Jenifur Charne

I've had this happen as well with a character with 100 acrobatics. You can fix it by going back into water, and leaving without jumping, so just swim to an edge and climb out.

Weird things:
Did the quest involving a certain painter and his brush, after completing it his missus told me I was welcome in their home.
Exit dialogue with her, she immediately says "You shouldn't be in here! Get out!"

Also, whilst training acrobatics at an inn (I forget which city) I was jumping constantly into a beam, for half an hour or so, with all the inn inhabitants watching me.
One of them looks at me and says "You look like you have quite a spring in your step." or something along those lines, made me giggle anyways.

Coming to an area with a large portion of the land missing, with the water texture below. Long drop.