The saves are stored in:
\morrowind\saves
If they are still there, you didn't delete everything.
If the game is installed under a subfolder of:
C:\Program Files\
OR:
C:\Program Files (x86)\
You should move it - please see the sticky threads for details on how to do this. At this point I strongly suggest it is the source of your problem.