This will never work in elder scrolls. Unless they have multiple voice actors for each race and gender. They can't use same voice on the account of accents and many different regions.
I don't hate the voice actor. I hate not having a silent protaganist.
You are the main character! If you want a talking protaganist go watch tv, or a movie, or read a book.
In a game like fallout you are supposed to fill in silence with your own motives, feeling and morality. In fallout 3 and NV you could be anyone.
In fallout 4 I have to turn of the voice audio to roleplay.
In skyrim I role played so much I never even did the main quest.
I fallout 4 I can't be anything but a one note character.
Edit
Sorry about being ranty I like almost everything about the game besides the voiced protagonist.