Fair enough. But you can talk to the failed incarnates. How can you talk to Neravar's soul if your using it. He some how has to have more then one spirit. Which is why I take a less traditional interpretation of "reincarnate" If Azura was just bringing back Neravar why not pull a Umaril? Some how the Nerevarine Prophesy fits her sphere better. But each incarnate is a different person.
Well, reincarnation wouldn't really work unless the souls could divide or something- like a metaphysical mitosis kinda deal- on account of the fact that babies are born all the time, and the population keeps growing. I doubt Nirn has the exact same population it did 1,000 years ago.
So if the failed Incarnates truly are Nerevar reborn, then yeah, you're talking to yourself in that cave, and it makes perfect sense. Assuming reincarnation and ghosts and goddesses getting revenge on magical elves who used the heart of a dead god to become gods themselves makes sense, of course.