I know it's not my mouse because I had the exact same problem with New Vegas until I installed the unofficial patch. It only happens with this game now and when I'll be holding Right Click to aim down the sights, he will randomly just go back to hip firing. It usually happens right after I shoot, but sometimes I can't even look through my scope at all.
Any ideas?