Cloudflare outage on June 21, 2022
blog.cloudflare.com
Cloudflare outage on June 21, 2022
1–10 of 234 posts
Re: Cloudflare outage on June 21, 2022
#2In a world where it can take weeks for other companies to publish a postmortem after an outage (if they ever do), I never ceases to amaze me how quickly CF manage to get something like this out.
I think it's a testament to their Ops/Incident response teams and internal processes, it builds confidence in their ability to respond quickly when something does go wrong. Incredible work!
Re: Cloudflare outage on June 21, 2022
#3...and yet they still push so hard for recentralization of the web...
Re: Cloudflare outage on June 21, 2022
#4Are there any steps that can be taken to test these types of changes in a non-production environment?
Re: Cloudflare outage on June 21, 2022
#507:42: The last of the reverts has been completed. This was delayed as network engineers walked over each other's changes, reverting the previous reverts, causing the problem to re-appear sporadically.
Ouch
Re: Cloudflare outage on June 21, 2022
#6In a world where it can take weeks for other companies to publish a postmortem after an outage (if they ever do), I never ceases to amaze me how quickly CF manage to get something like this out. I think it's a testament to their Ops/Incident response teams and internal processes, it builds confidence in their ability to respond quickly when something does go wrong. Incredible work!
Yep, look at heroku and their big incident, and the amount of downtime they've had lately.
Re: Cloudflare outage on June 21, 2022
#7...and yet they still push so hard for recentralization of the web...
CloudFlare are a hosting provider and CDN, they aren't "push[ing] ... hard for recentralization of the web".
If it was AWS, Akamai, Google Cloud, or any of the other massive providers this comment wouldn't be made. I don't really understand the association between centralisation and CloudFlare, other than it being a Meme.
Re: Cloudflare outage on June 21, 2022
#8Time and time again, this type of response proves that it's the right way handle a bad situation. Be humble, apologize, own your mistake, and give a transparent snapshot into what went wrong and how you're going to learn from the mistake.
Or you could go the opposite direction and risk turning something like this into a PR death spiral.
Re: Cloudflare outage on June 21, 2022
#9Am I the only who really doesn't think this is a big deal? They had an outage, they fixed it very quickly. Life goes on. Talking about the outage as if it's reason for us to all ditch CF, then buy/ run our own hardware (which will be totally better), so hyperbolic.
Re: Cloudflare outage on June 21, 2022
#10BGP changes should be like the display resolution changes on your PC...
It should revert as a failsafe if not confirmed within X minutes.