Live data from Hacker News

Ask HN: Do you test in production?

news.ycombinator.com

71–75 of 75 posts

Re: Ask HN: Do you test in production?

#71
post #9

Lots of ways to test in production. IMO the way you are suggesting – injecting synthetic data into prod – is the worst of both worlds. You aren't actually testing real world use cases, and end up polluting your prod environment. Some common ways to go about it: - Feature flags: every new change goes into your codebase behind a flag. You can flip the flag for a limited set of users and do a broader rollout when ready.…

[dead]

Re: Ask HN: Do you test in production?

#73
yes, I do testing on production usually. I feel much comfortable if can perform enough testing in production, before inform end-user to start use it.

In my experience, it starts from DESIGN PHARSE, which should be awared to make it possible to test in production without impact end-user. CODING PHARSE shall make some arrangement to provide more possibility for testing on prodcution environment. DEPLOYMENT process shall be able to provide a time-gap like "pre-launch". Then will be happy to test in the "pre-launch" period in production, and feel confidence to infrom end-user for a release.

Re: Ask HN: Do you test in production?

#74
Actually never seen a team that hasn't tested their system in prod. Just be careful with fake data, you might be testing something that does not mirror actual application usage. Feature flags, betas, etc. can be safer than fake data.

Re: Ask HN: Do you test in production?

#75

Earlier quoted context omitted.

Hah did we even pretend to have a sandbox at CME? Outside like Saturday testing parties.

There was a sandbox but it never behaved like the prod environments. To the point I had to have a flag to tell my order entry code if we were being certified in the sandbox or actually trading in prod. I’ve heard that got better after they replaced the gateways with fpga but don’t know for sure.

Ah yes, it's always great when you need special code to pass the certification test after which you disable for real prod.
Post reply on HN