I think people are making the mistake of comparing it to previous games and basing their judgement on the same expectations.
It's something we've all been guilty of one way or another for a game series. However I think Bethesda prioritise new experiences, which is something that quite frankly needs to be emulated more so in the games industry.
I'm sick of every COD being basically the same with more crap added in. The same with Assassin's Creed. It's kind of fresh to have a developer where their next game is in a sense a continuation of existing ethos, but at the same time branches in new directions.
Of course there's always the fan base. We do matter and our opinion counts. Would I want the next TES game to be basically an action game? Hell no. But Bethesda don't do that.
There's an argument for both sides, I prefer to see the positives and compare their practices to other companies, because none are perfect and all of them let their "fans" down somewhere along the way.