If you need to justify it to yourself, that may be a sign that you don't want to do it. Maybe writing this thread is another clue that stat optimizing is really not your priority.
Sometimes I have done very well in PvP, but the character I played was naturally gifted and well geared.
Sometimes I have done well despite poorer racials or gear.
The latter, I am proud of, can brag of, and own every moment of the victory in sweet 1080p HD in my mind.