All of us test in production all the time (2019)
increment.com
All of us test in production all the time (2019)
1–10 of 164 posts
Re: All of us test in production all the time (2019)
#2This article is inane to me. Someone decided to write a lengthy blog post on the deliberate and obvious misinterpretation of a meme.
DevOps and Observability are well described disciplines. I don't know anyone who has uttered the meme "I don't always test, but when I do, I test in production" who meant that monitoring, observing and reviewing prod behavior is bad. They invariably meant that they were rushed to release things in prod before it was adequately verified to ensure your customers don't have crappy experiences.
Re: All of us test in production all the time (2019)
#3This article is inane to me. Someone decided to write a lengthy blog post on the deliberate and obvious misinterpretation of a meme. DevOps and Observability are well described disciplines. I don't know anyone who has uttered the meme "I don't always test, but when I do, I test in production" who meant that monitoring, observing and reviewing prod behavior is bad. They invariably meant that they were rushed to releas…
Couldn't agree more. Of course you use your product and do service quality measurements. What you don't do is toss "untested" code at your customers (possible exception here is hotfixes), which is what the meme means. Bad post written by someone either intentionally misinterpreting the meaning or dangerously unqualified to understand it.
Re: All of us test in production all the time (2019)
#4This article is inane to me. Someone decided to write a lengthy blog post on the deliberate and obvious misinterpretation of a meme. DevOps and Observability are well described disciplines. I don't know anyone who has uttered the meme "I don't always test, but when I do, I test in production" who meant that monitoring, observing and reviewing prod behavior is bad. They invariably meant that they were rushed to releas…
Another read is that it’s just a hook to get into a meaningful subject - observability can be considered part of the test process. The inflammatory title gets clicks!
The author’s product is based on folks accepting this premise and seeking tools to do better.
I do think the setup to get to the substance is a bit long and indirect - but it’s not a given, especially at series B/C startups that folks think about production monitoring as part of the QA process so I do like to see more pieces on that.
Re: All of us test in production all the time (2019)
#5The author apparently didn’t get the sarcasm in the "I test in prod" meme.
Re: All of us test in production all the time (2019)
#6The author apparently didn’t get the sarcasm in the "I test in prod" meme.
I think that's unfair - my reading is the article was that no matter how well you test before prod, there are emergent factors that cannot be tested for - and I agree. Test what you can pre release and have good tools to handle failures and be aware of the risk landscape.
Re: All of us test in production all the time (2019)
#7This article is inane to me. Someone decided to write a lengthy blog post on the deliberate and obvious misinterpretation of a meme. DevOps and Observability are well described disciplines. I don't know anyone who has uttered the meme "I don't always test, but when I do, I test in production" who meant that monitoring, observing and reviewing prod behavior is bad. They invariably meant that they were rushed to releas…
Couldn't agree more. Of course you use your product and do service quality measurements. What you don't do is toss "untested" code at your customers (possible exception here is hotfixes), which is what the meme means. Bad post written by someone either intentionally misinterpreting the meaning or dangerously unqualified to understand it.
> willfully misinterpreting
Often, when someone looks like they are “willfully misinterpreting” something, they are actually presenting uncomfortable implications or experiences of how a phrase is put into practice. Right or wrong, it is irritating to listen to.
Is it worth enduring your irritation in order to see if someone is meaningfully correct?
—————
> Don’t toss “untested” code.
“tested” is not a binary state. Code could always be better-tested —- otherwise why would you have hotfixes?
Re: All of us test in production all the time (2019)
#8The author apparently didn’t get the sarcasm in the "I test in prod" meme.
Is that meme sarcastic? I thought it was an expression of dismay.
Re: All of us test in production all the time (2019)
#9This article is inane to me. Someone decided to write a lengthy blog post on the deliberate and obvious misinterpretation of a meme. DevOps and Observability are well described disciplines. I don't know anyone who has uttered the meme "I don't always test, but when I do, I test in production" who meant that monitoring, observing and reviewing prod behavior is bad. They invariably meant that they were rushed to releas…
The opinion of the article is that the catchphrase has become an excuse to build poor observability and in-prod testing tools, and we should be better about that.
Re: All of us test in production all the time (2019)
#10[deleted]