To rule it out as falsehood would be to ignore the whole truth.
The Dunmer also believed that Vivec got his powers by doing good deeds, the Daedra are their ancestors, and that continuing to raid Black Marsh for slaves was a good idea.
I'm not saying they're necessarily wrong about ebony, but their beliefs are not infallible.