I've noticed this syndrome a little bit. I find that if I'm closer to the target that 50/50 will at least be some kind of hit
almost every other time.
Maybe you're just a lousy shot...... I'm kidding.
After some perks and skill improvements, this may become more "statistically logical" over time.