Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

Post reply on HN
Print view View original

541–550 of 630 posts

Re: Google Cloud Is Down

#541

Post by didibus »

snicker7 wrote: post #347
StreamBright wrote: post #317

Earlier quoted context omitted.

I am not sure if a single S3 outage pushed any big names into their own "datacenter". S3 has still the world record of reliability that you cannot challenge with your inhouse solutions. You can prove it otherwise. I would love to hear a solution that has the same durability, avabiality and scalability as S3. For the downvoters, please just link here the proof if you disagree. Here are the S3 numbers: https://aws.amaz…

It's not so much AWS vs. in-house. But AWS (or GCP/DO/etc.) vs. multi/hybrid solutions. The latter of which would presumably have lower downtime.

I don't see why multi/hybrid would have lower downtime. All cloud providers as far as I know, though I know mostly of AWS, already have their services in multiple data-centers and their endpoints in multiple regions. So if you make yourself use more then one of their AZs and Region, you would be just as multi as with your own data center.

Re: Google Cloud Is Down

#542

Post by rincebrain »

jonhohle wrote: post #390
rincebrain wrote: post #267

Earlier quoted context omitted.

Years ago, when I was playing with AWS in a course on building cloud-hosted services, it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage, so while technically all our VMs hosted out of other AZs were extant, all our attempts to manage our VMs via the web UI or API were timing or erroring out. I understand th…

> it was well-known that all the AWS management was hosted out of a single zone, and there were several days we had to cancel class because us-east-1 had an outage Maybe you mean region, because there is no way that AWS tools were ever hosted out of a single zone (of which there are 4 in us-east-1). In fact, as of a few years ago, the web interface wasn’t even a single tool, so it’s unlikely that there was a global o…

Quite possibly, it has been a number of years at this point, and I didn't dig out the conversations about it for primary sourcing.

Re: Google Cloud Is Down

#543

Post by dyu »

dreamer_soul wrote: post #504
_Marak_ wrote: post #489

Earlier quoted context omitted.

This should be voted higher up. According to https://twitter.com/bgp4_table , we have just exceeded 768k Border Gateway Protocol routing entries, which may be causing some routers to malfunction.

Isn't it weird that it's happening now even though that number was surpassed nearly a month and half ago?

Different locations see different counts because of aggregation/de-aggregation.

Re: Google Cloud Is Down

#544

Post by nektro »

kibwen wrote: post #492
_xerxes_ wrote: post #349

Nest is down too, not surprising given they are part of Google. What I don't understand is why I can't still control my devices over my local network. Why does the system even require access to Google servers?

Let's make the following the tech mantra of the next decade: "the Internet Of Things can never possibly work until the LAN Of Things does" .

the IoT trend really needs to stop

Re: Google Cloud Is Down

#545

Post by dijit »

oarsinsync wrote: post #245
PerfectElement wrote: post #173

Earlier quoted context omitted.

The small bare metal hosting company I use for some projects hardly goes down, and when there is an issue, I can actually get a human being on the phone in 2 minutes. Plus, a bare metal server with tons of RAM costs less than a small VM on the big cloud providers.

> a bare metal server with tons of RAM costs less than a small VM on the big cloud providers Who are you getting this steal of a deal from?

Anywhere. Really.

Cloud costs roughly 4x than bare metal for sustained usage (of my workload). Even with the heavy discounts we get for being a large customer it’s still much more expensive. But I guess op-ex > cap-ex

Re: Google Cloud Is Down

#546

Post by dijit »

chupasaurus wrote: post #207
TeMPOraL wrote: post #143

Earlier quoted context omitted.

Solutions based on third-party butts have essentially two modes: the usual, where everything is smooth, and the bad one, where nothing works and you're shit out of luck - you can't get to your data anymore, because it's in my butt, accessible only through that butt, and arguably not even your data. With on-prem solutions, you can at least access the physical servers and get your data out to carry on with your day whi…

Any solution would be based on third parties, the robust solution is either to run your own country with fuel sources for electricity and army to defend the datacenters or rely on multiple independent infrastructures. I think the latter is less complex.

This is a ridiculous statement. Surely you realise that there is a sliding scale.

You can run your own hardware and pull in multiple power lines without establishing your own country.

I’ve ran my own hardware, maybe people have genuinely forgotten what it’s like, and granted, it takes preparation and planning and it’s harder than clicking “go” in a dashboard. But it’s not the same as establishing a country and source your own fuel and feed an army. This is absurd.

Re: Google Cloud Is Down

#548

Post by runlevel1 »

djsumdog wrote: post #260
colinbartlett wrote: post #182

Earlier quoted context omitted.

I don't know about Steam, but I know Apple must use Google Cloud: https://www.apple.com/support/systemstatus/

Guess they don't eat their own dog food; no racks of proprietary Apple servers anywhere (unless they somehow run Darwin images in Google Cloud)

Apple runs Linux on the vast majority of the servers behind their cloud offerings.

Re: Google Cloud Is Down

#549

Post by justinator »

aaronblohowiak wrote: post #527
mkl wrote: post #524

Earlier quoted context omitted.

That sounds fascinating! How often does your team have to leap into action?

We don’t usually discuss the frequency of unplanned failovers, but I will tell you that we do a planned failover at least every two weeks. The team also uses traffic shaping to perform whole system load tests with production traffic, which happens quarterly.

Do you do any chaos testing? Seems like it would slot right in, there.

Re: Google Cloud Is Down

#550

Post by ryacko »

Raidion wrote: post #502
_xerxes_ wrote: post #349

Nest is down too, not surprising given they are part of Google. What I don't understand is why I can't still control my devices over my local network. Why does the system even require access to Google servers?

It doesn't, but it sure was easier implimenting one connection through Google APIs instead of two: one through Google and one through local network.

I have not implemented additional APIs by running a local DNS server.
Post reply on HN