“Good logging” is mentioned here. Can somebody recommend a good write-up of what good logging consists of?
Now I can see what users are affected by which errors however often. Alerts are now trivial to implement. They key is being able to debug an issue after the fact. I like to include a copy-pastable curl call when I can so I can manually reproduce an issue easily as an example