The worst colorblind experience I've had was playing basketball against a team with uniforms I couldn't tell a color difference. I had to focus on the style and typeface difference, as well as if I recognized the person or not. Extremely frustrating.
Second worst was teachers in elementary asking why the grass was brown and water was purple in my drawings. Huh?