Live data from Hacker News

Fastly Outage

fastly.com

441–450 of 740 posts

Re: Fastly Outage

#441

Yeah so it's been mentioned in the comments already, but to everyone in Fastly right now: I feel for you. Something like this must be insanely stressful, and not just during the outage. There will be (should be) a massive post-mortem. People will be losing sleep over this for days, weeks, months. :( Edit: There seems to be a major empathy outage in this thread. Disgusted but not surprised, unfortunately.

Call me old fashioned but the latest trend of showing "empathy" for a serious incident, then proceeding to dance around the aftermath of it, whilst people give themselves a pat on back in a retro/post-mortem, isn't the way to do it. People need to be blamed, and responsibility for actions taken (without covering asses)

the attitude that "people need to be blamed" will never improve reliability in the long run. people come and go; systems and processes endure. blaming people is the best way to avoid making durable improvements to systems and processes.

Re: Fastly Outage

#442

basically the internet is down reddit, stackoverflow, github, paypal, pypi, twitter, twitch, NYT, CNN, BBC, the Guardian... edit: wow, even Amazon.com relies on Fastly for some of its edge caches!

> stackoverflow

How will they troubleshoot the error messages now?

Re: Fastly Outage

#445
post #381

Earlier quoted context omitted.

The point isn't to dance around the incident, but to not blame people. You can blame systems, design, engineering culture, processes, but don't blame people. Even if someone accidentally pressed the 'destroy prod' button, that's not the fault of that person, it's the fault of that button existing and being accessible in the first place. I have no empathy for Fastly-the-company. I hate the fact that the Internet is ce…

I disagree. People implemented those systems, so if you are correct that it is the systems fault, then it is also a persons fault. People must be held accountable to have good incentives to reduce such outtages in the future. I do agree though that we should always be compassionate and realistic with other humans.

Loss of trust in a service provider and the afterwards loss of business is quite an incentive. Having someone drawn and quartered just provides an incentive to scapegoat.

Re: Fastly Outage

#447
post #99
post #50

Earlier quoted context omitted.

Bitwarden is also down (the Web Vault, not the website).

I will never understand the meaning of putting CDN behind CDN.

What makes sense in the world is what puts bacon on the table and not what actually make sense.

Re: Fastly Outage

#448
post #386

Those of you that work in DevOps, SRE or are CTOs. What kind of things do you put in place to manage these kind of centralised issues that are beyond your control?

These issues are in your control - not for the centralised service but your use of them. You can build appropriate redundancy for the components/providers in your stack and the budget you have.

Re: Fastly Outage

#450
post #181
post #164

Earlier quoted context omitted.

Mediation is a real word though?

That is true, but the typo is because they presumably meant to reference this: https://en.wikipedia.org/wiki/Guru_Meditation

That wiki references the Varnish version.

I think it's an intentional alteration of the original, given the context.

Post reply on HN