I have had this happen to me, but my question to those who have also had this happen....did you to take the "Wild Wasteland" trait? I ask this because when I starting walk out of the area I lost color in and finally got my color to come back it did it in a way that looked programmed not a video glitch. Everything on my screen acutally went double vision shifted to the left alil and when it came back to center up the color returned. I have never used any of the in-game drugs other than stimpacks so I know it was not an effect from them. I am just wondering because this may be a side effect of taking that trait.

You may have been poisoned by someone/thing that's about how I remember it goes when being poisoned. It also seems that the poison activates at random times too, I once went 30mins after fighting a bunch of radscorpions only to have that hit me.

I had this happen several times during my first playthrough. I didn't take the Wild Wasteland trait. I eventually realized it was identical to the low-light vision ability that you get from Cateye and Nuka-Cola Quartz. I think it's a bug related to the Friend of the Night perk, which I've heard doesn't work for some people (I've never taken it).