Live data from Hacker News

Tell HN: AWS appears to be down again

news.ycombinator.com

301–310 of 497 posts

Re: Tell HN: AWS appears to be down again

#301
post #169

Earlier quoted context omitted.

I don't know about AWS, but I know a lot of us uptime monitoring makers use (and pay) for competitor's products to know if we're down.

Rightly so. My point is a company can self-audit without having to pay a competitor.

I think that is inherently riskier because you never know on what axis you will have a failure and it is difficult to exclude all shared axes.

Re: Tell HN: AWS appears to be down again

#302
post #212

Earlier quoted context omitted.

This has been true for a long time and it is not a bad thing. It’s an easy target to romanticize but realistically, any alternative is basically a way of saying: “let’s stop evolving.”

Disagree. Wanting to evolve differently doesn't mean halting. It's a call not to devolve.

I certainly think this is a subjective, “no one right answer” discussion topic.

From my perspective, we require abstractions in order to free our intellectual capacity up for the next layer of complexity.

Re: Tell HN: AWS appears to be down again

#303

HOST THE GODDAMN STATUS PAGE ON AZURE FOR FUCKS SAKE. There is zero excuse for this shit. Be professional. Acknowledge reality. It is logically impossible to run your own status page. Trying to do so just wastes everyone else on the internet's time when you have an outage.

If the status page is down, you know the system is down. Mission accomplished. Go ahead.

Re: Tell HN: AWS appears to be down again

#304

We are barbarians occupying a city built by an advanced civilization, marveling at the hot baths but know nothing about how their builders keep them running. One day, the baths will drain and anyone who remembers how to fill them up will have died.

We are the advanced civilization that has built those hot baths. Being an advanced civilization, it's safe to assume that no single person knows all the knowledge necessary to build another hot bath, because it has long surpassed how much one person can learn in a lifetime.

But somehow there are multiple organizations that "know" how to build another hot bath, and newer and bigger baths are continuously being built all across the Empire.

And occasionally one of them stops working and thousands of citizens are angry, because they feel, being honest citizens of the Empire, they are entitled to enjoy these hot baths. Sometimes their very livelihood depends on the baths running.

Then the bath is fixed, and all is well again.

Re: Tell HN: AWS appears to be down again

#305
post #282
post #210

Earlier quoted context omitted.

Many years ago I stood at the window of my comfortable apartment, watching wind and cold rain rage outside. I thought about my cave men ancestors who during such a storm if they needed water would have to go out and get it, getting themselves soaked. If I wanted water, the tap in the kitchen would give it to me, in a nice controlled fashion. If I did feel like having water rain down upon me, my shower would do that,…

Not to mention that many of the skills needed by the original cavemen to survive are gone in today's society. In other words, if we were to compete with the original cavemen in their environment, we would most likely fare rather poorly, at least in the short term. Not trying to glorify off-the-grid living or anything, but I think it's interesting to think that in some (very specific) ways, the cavemen were actually s…

>if we were to compete with the original cavemen in their environment, we would most likely fare rather poorly

The understatement of the epoch

Re: Tell HN: AWS appears to be down again

#306
post #85

Earlier quoted context omitted.

They did add an update, faster than last time: "7:42 AM PST We are investigating Internet connectivity issues to the US-WEST-2 Region." https://status.aws.amazon.com/ Edit: They added US-WEST-1: "7:52 AM PST We are investigating Internet connectivity issues to the US-WEST-1 Region." Edit: Found root case, maybe? "8:01 AM PST We have identified the root cause of the Internet connectivity to the US-WEST-1 Region and ha…

It's interesting that west-2 was quicker to create the incident (despite the issue starting a bit later there, at least by our experience), and while they both "identified" at the same time, west-2 also waited longer to call it resolved. I assume there are different teams responsible for each, is the west-2 team just more on top of things?

West-2 also launched many years after us-east-1, so less legacy to deal with.

Re: Tell HN: AWS appears to be down again

#307
post #280
post #210

Earlier quoted context omitted.

Many years ago I stood at the window of my comfortable apartment, watching wind and cold rain rage outside. I thought about my cave men ancestors who during such a storm if they needed water would have to go out and get it, getting themselves soaked. If I wanted water, the tap in the kitchen would give it to me, in a nice controlled fashion. If I did feel like having water rain down upon me, my shower would do that,…

> Then I realized that I don't know how to build the systems that I was relying on for my supposed superiority, or even how some of them work. I used to have this joke(?) with my friends: remember Mark Twain's "A Connecticut Yankee in King's Arthur Court"? The titular Yankee basically upends the (faux) medieval society he gets transported to, "inventing" all sorts of technological miracles. Well, I'm a software devel…

Also on a similar theme: https://en.wikisource.org/wiki/I,_Pencil (it's intended to be about free market economies, but you can also read it as something about knowing how even simple modern marvels work at all).

Re: Tell HN: AWS appears to be down again

#308
post #280
post #210

Earlier quoted context omitted.

Many years ago I stood at the window of my comfortable apartment, watching wind and cold rain rage outside. I thought about my cave men ancestors who during such a storm if they needed water would have to go out and get it, getting themselves soaked. If I wanted water, the tap in the kitchen would give it to me, in a nice controlled fashion. If I did feel like having water rain down upon me, my shower would do that,…

> Then I realized that I don't know how to build the systems that I was relying on for my supposed superiority, or even how some of them work. I used to have this joke(?) with my friends: remember Mark Twain's "A Connecticut Yankee in King's Arthur Court"? The titular Yankee basically upends the (faux) medieval society he gets transported to, "inventing" all sorts of technological miracles. Well, I'm a software devel…

Inventing the printing press was more difficult than it seems at first. In addition to the idea of unsing movable type significant development of the correct alloys for the types was necessary. The alloy needs to be able to be cast easily and at the same time be durable to be reused for a large enough number of print runs. In addition the proper ink needs to be developed...

Re: Tell HN: AWS appears to be down again

#309

We are barbarians occupying a city built by an advanced civilization, marveling at the hot baths but know nothing about how their builders keep them running. One day, the baths will drain and anyone who remembers how to fill them up will have died.

So long as you live in a city you are probably forgetting most of the ways to survive. I could not even try to discover which berries are edible without killing myself. However, I can teach advanced maths to a largish group of students without much trouble.

as an NYC-born, growing up with bi-monthly boy scout meetings and yearly "wilderness camps" (pitching tents in open fields, pit latrines, war games/survival, etc.) really helped fill in that gap :)

i wonder if there's anything like that for adults

Re: Tell HN: AWS appears to be down again

#310

Earlier quoted context omitted.

Surely we are way past the point where someone knows how the whole thing works, all the way down. I doubt even a very skilled engineer would know how his own machine works all the way down. What I think happens mostly is the skilled dev can use his experience to know where to investigate and where to look for solutions. The question is organisational. Might it be that certain orgs have gotten so convoluted that they…

I do contracting dev work and my specialty is being able to drill down into any part of the engineering assets, ops, sec, dev. People think someone like me is slow and expensive until they have a problem that no one else wants to touch.

You know how to debug kernel issues? You know how AWS virtualization works and how to diagnose a problem with the AWS networking stack?
Post reply on HN