Lots of ways to test in production. IMO the way you are suggesting – injecting synthetic data into prod – is the worst of both worlds. You aren't actually testing real world use cases, and end up polluting your prod environment. Some common ways to go about it: - Feature flags: every new change goes into your codebase behind a flag. You can flip the flag for a limited set of users and do a broader rollout when ready.…
Ask HN: Do you test in production?
71–75 of 75 posts
Re: Ask HN: Do you test in production?
#72Re: Ask HN: Do you test in production?
#73In my experience, it starts from DESIGN PHARSE, which should be awared to make it possible to test in production without impact end-user. CODING PHARSE shall make some arrangement to provide more possibility for testing on prodcution environment. DEPLOYMENT process shall be able to provide a time-gap like "pre-launch". Then will be happy to test in the "pre-launch" period in production, and feel confidence to infrom end-user for a release.
Re: Ask HN: Do you test in production?
#74Re: Ask HN: Do you test in production?
#75Earlier quoted context omitted.
Hah did we even pretend to have a sandbox at CME? Outside like Saturday testing parties.
There was a sandbox but it never behaved like the prod environments. To the point I had to have a flag to tell my order entry code if we were being certified in the sandbox or actually trading in prod. I’ve heard that got better after they replaced the gateways with fpga but don’t know for sure.