I'm on the fence with this one. Text based computer games started with Zork and it makes sense considering the fact your character can't talk at all.
On the other hand while the voice acting may not always be up to par and NPC's especially followers are limited in what they can say I feel like it adds atmosphere to the game just like Ulfric's speech does or the dialogue with Tullius in the opening sequence.
There are a lot of good moments in the game that come with the NPC dialogue and I would hate for that to get cut out to be replaced by text, to me it would be a step backward.
So I guess that puts me on the side of the fence of keep the dialogue but add more lines and hopefully at some point they can add a voice to the player character. With the added memory I would even hope they can make some changes that would be able to breathe more life into the world of TES with greater depth in conversations and more dialogue options which of course means more lines for voice actors. Hopefully more voice actors along with it.
Maybe it's just me, if I wanted to read a fantasy novel (Oh how many Fantasy novels I've read in my time, probably over a hundred. I love Eddings, Tolkein, Roberts, McCaffrey and on and on) then by gum I would read a fantasy novel.
I play ES not to read a fantasy novel but to play a game and what I see satisfies me. Maybe I'm just an oddity, it sure seems like it on the forums and has since I got here.