Coming from someone with little to no PvP experience I can say that not doing the quests at the beginning can cause a poor taste in the player's mouth. I have only done PVP twice, the first time I did not do the introductory quests and felt much like the OP. It seemed to be that there was nothing more than to find a zerg and go with it. Otherwise, running around (prior to having a horse) to the battles introduced me to being killed by the opposing forces who were sneaking and invisible to me. Granted, most of my frustration was with the lag at the time, but I left the PvP world with a feeling that PvP was not for me.
This latest beta, I did do the introductory quests, understood what was going on, and took some of the quests that were offered on the bounty boards. Having less lag than the previous test (only time it became hard to play was when there were 40-50 players running around on my screen after the battle), and exploring the quests, I realized that the idea of PvP appealed to me. There was a lot to do, without doing any of the PvE quests.
I think that players may do a disservice to themselves, and to the game, by not doing the initial quests on their first character. After that is done, I can see bypassing the quests (even though they give you alliance points and you can outfit yourself better than just gold for PvP). I am honest enough to understand that I caused an incorrect review of the PvP since I did not fully go through the steps that the developer created for the player. If I did not go through that quest line, I would still have a unfavorable view of PvP and most likely would be questioning my pre-order of the game.
tl;dr: Understand what is offered in PvP before stating it is not to your liking