Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

451–460 of 630 posts

Re: Google Cloud Is Down

#452
post #311

Earlier quoted context omitted.

Looks like they are having trouble updating their statuses. 19008 was supposed to be updated over an hour ago. Meanwhile, 19009 has the same comment posted three times. I'm guessing internal tools are barely working at best.

That is normal for Google status pages. They don't want to admit fault or place blame because there can be legal and commercial ramifications, so they can only say canned responses.

Updating a status page, sure. They aren't going to say "JamesBondService is having issues because a bug was deployed", but they usually don't repeat the same message 3 times in the same minute and they are usually pretty good about sticking to an update "within SLA"

Re: Google Cloud Is Down

#453
I was finishing a university assignment with the deadline 90mins away.

I wanted to upload a video of the project to YouTube and add a link to it in the report. YouTube takes a long time to process the video, and then says it's unavailable.

I go to Vimeo: it's down.

I upload the video to Dropbox, and copy its link to the report.

But my report was a Google doc. And when I tried to export it as PDF (which I had not done yet) it couldn't do it. I never hated google more.

Eventually the video went through to YouTube, and I could export the PDF on the third try, but this really made me conscious of my dependance on Google.

Re: Google Cloud Is Down

#454
post #337

Earlier quoted context omitted.

Google is well known for not caring about small shops, only if you are a multi million dollar customer with dedicated account manager you can expect reasonable support. That's been the case forever with them.

Does Amazon treat smaller customers any better? I am genuinely asking, as I have no clue.

Absolutely. I've seen them wipe a number of bills away for companies that have screwed up something. They definitely take a longer view on customer happiness than GCP. Azure also tends to be pretty good in this regard.

Re: Google Cloud Is Down

#455
post #216

The two Google Cloud networking incidents are: Incident #19008 began at 2019-06-02 12:48. https://status.cloud.google.com/incident/cloud-networking/19... Incident #19009 began at 2019-06-02 12:53. https://status.cloud.google.com/incident/cloud-networking/19... Times are US/Pacific

dang et al.: I’d make 19009 the URL for this (GCE Just reported first, but this is an outage / networking issue in the Eastern US).

#19008 mentioned by parent is not the GCE one, there are two networking ones: #19008 and #19009.

The #19008 (networking) says there will be an update by "13:30 US/Pacific", but as of 17:05 there is no update.

Similarly, #19003 (GCE) says there will be an update by "16:00 US/Pacific", but no update as of 17:05.

All the latest updates seem to only be in the third incident #19009 (networking).

Re: Google Cloud Is Down

#456
post #454

Earlier quoted context omitted.

Does Amazon treat smaller customers any better? I am genuinely asking, as I have no clue.

Absolutely. I've seen them wipe a number of bills away for companies that have screwed up something. They definitely take a longer view on customer happiness than GCP. Azure also tends to be pretty good in this regard.

[deleted]

Re: Google Cloud Is Down

#457

Earlier quoted context omitted.

Years ago, when I was playing with AWS in a course on building cloud-hosted services, it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage, so while technically all our VMs hosted out of other AZs were extant, all our attempts to manage our VMs via the web UI or API were timing or erroring out. I understand th…

> it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage Maybe you mean region, because there is no way that AWS tools were ever hosted out of a single zone (of which there are 4 in us-east-1). In fact, as of a few years ago, the web interface wasn’t even a single tool, so it’s unlikely that there was a global o…

Just this year an issue in us-east-1 caused the console to fail pretty globally.

Re: Google Cloud Is Down

#458

Earlier quoted context omitted.

There was a massive push after that to have everything regionalized. It's not 100% but it's super close at this point.

S3 buckets are a global namespace, so control plane operations have to be single-homed. As an example, global consensus has to be reached before returning a success response for bucket creation to ensure that two buckets can't be created with the same name.

The availability of CreateBucket shouldnt effect the availability of customers apps. This tends to be true anyway because of the low default limit of buckets per account (if your service creates buckets as part of normal operation it will run out pretty quickly).

The difference with Google Cloud is a lot of the core functionality (networking, storage) is multi region and consistent. The only thing thats a bit like that in AWS is IAM, however IAM is eventually consistent.

Re: Google Cloud Is Down

#459

Earlier quoted context omitted.

Years ago, when I was playing with AWS in a course on building cloud-hosted services, it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage, so while technically all our VMs hosted out of other AZs were extant, all our attempts to manage our VMs via the web UI or API were timing or erroring out. I understand th…

> it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage Maybe you mean region, because there is no way that AWS tools were ever hosted out of a single zone (of which there are 4 in us-east-1). In fact, as of a few years ago, the web interface wasn’t even a single tool, so it’s unlikely that there was a global o…

Quoting https://docs.aws.amazon.com/general/latest/gr/rande.html

"Some services, such as IAM, do not support Regions; therefore, their endpoints do not include a Region."

There was a partial outage maybe a month and a half ago where our typical AWS Console links didn't work but another region did. My understanding is that if that outage were in us-east-1 then making changes to IAM roles wouldn't have worked.

Re: Google Cloud Is Down

#460

Earlier quoted context omitted.

It's not so much AWS vs. in-house. But AWS (or GCP/DO/etc.) vs. multi/hybrid solutions. The latter of which would presumably have lower downtime.

Why would you think that self-managed has lower downtime than AWS using multiple datacenters/regions?

Multi/hybrid means you use both self managed and AWS datacenters.
Post reply on HN