Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

581–590 of 630 posts

Re: Google Cloud Is Down

#581
post #370
post #344

Earlier quoted context omitted.

> For the downvoters, please just link here the proof if you disagree. https://wasabi.com/

How can they possibly guarantee eleven nines? Considering I’ve never heard of this company and they offer such crazy-sounding improvements over the big three, it feels like there should be a catch.

11 9s of durability, barely two 9s of availability

I'm sure that's okay if you do bulk processing / time-independent analysis, but don't host production assets on wasabi.

Re: Google Cloud Is Down

#582
post #83

You know this reminds me of a bad taste that Google Sales team left when I asked for some of my billing that I was unaware of running after following a quickstart guide. AWS refunded me in the first reply on the same day! GCP sales rep just copy pasted a link to a self support survey that essentially told me, after a series of YES or NO questions that they can't refund me. So why not just tell your customers like it…

>I asked for some of my billing that I was unaware of running >I have called my bank to do a chargeback You're issuing a chargeback because you made a mistake and spent someone else's resources? And you're admitting to this on HN? I'm not a lawyer, but that sounds like fraud and / or theft to me.

It’s not, read the terms of your credit card. It’s basically “I didn’t intend to buy this. I tried in good faith to contact the merchant for return and support. I was ignored. I’m contacting you.”

It’s pretty convenient for companies like Comcast and Google that have poor customer service.

Re: Google Cloud Is Down

#583
post #176
post #20

GCP status page is worthless as it's always happy and green when production systems are down and then they might acknowledge something an hour later

I swear most status pages are run by folks who aren't "there".

It’s an easy problem to fix as basically services should emit performance data, openly, and the status page should just summarize that. So if a service doesn’t report out, it’s assumed down or erroring out.

Having an excel file where people enter statuses is not very useful to me as a customer. That’s more like a blog.

Re: Google Cloud Is Down

#584
post #67

Earlier quoted context omitted.

> including unfortunately the tooling we usually use to communicate across the company about outages. There's some irony in that.

AWS experienced a major outage a few years ago that couldn't be communicated to customers because it took out all the components central to update the status board. One of those obvious-in-hindsight situations. Not long after that incident, they migrated it to something that couldn't be affected by any outage. I imagine Google will probably do the same thing after this :)

The status page is the kind of thing you expect to be hosted on a competitor network. It is not dogfooding but it is sensible.

Reminds me of when I was working with a telecoms company. It was a large multinational company and the second largest network in the country I was in at the time.

I was surprised when I noticed all the senior execs were carrying two phones, of which the second was a mobile number on the main competitor (ie the largest network). After a while, I realised that it made sense, as when the shit really hit the fan they could still be reached even when our network had a total outage.

Re: Google Cloud Is Down

#585
post #523

Earlier quoted context omitted.

None of the big cloud providers have unrecoverably lost hosted data yet, despite sorting vast volumes, so this doesn't seem BS to me.

Not losing any data yet doesn't give justification for such absurd numbers

Those numbers probably aren't as absurd as you think. 16 9s is, I think 10 bytes lost per exabyte-year of data storage.

There's perhaps the additional asterisk of "and we haven't suffered a catastrophic event that entirely puts us out of business". (Which is maybe only terrorist attacks). Because then you're talking about losing data only when cosmic-ray bitflips happen simultaneously in data centers on different continents, which I'd expect doesn't happen too often.

Re: Google Cloud Is Down

#586
post #266

https://www.reddit.com/r/sysadmin/comments/bw1gye/most_googl... https://www.zdnet.com/article/some-internet-outages-predicte... 768k Day

Will this affect more than just Google? I haven't seen any outages from other cloud providers.

Re: Google Cloud Is Down

#587

Earlier quoted context omitted.

Back when S3 failures would take town Reddit, parts of Twitter .. Netflix survived because they had additional availability zones. I can remember the bigger names started moving more stuff to their own data centers. AWS tries to lock people in to specific services now which makes it really difficult to migrate. It also takes a while before you get to the tipping point where hosting your own is more financially viable…

I am not sure if a single S3 outage pushed any big names into their own "datacenter". S3 has still the world record of reliability that you cannot challenge with your inhouse solutions. You can prove it otherwise. I would love to hear a solution that has the same durability, avabiality and scalability as S3. For the downvoters, please just link here the proof if you disagree. Here are the S3 numbers: https://aws.amaz…

Cannot challenge with your own inhouse solutions, you say?

Challenge Accepted... and defeated: https://blogs.dropbox.com/tech/2016/03/magic-pocket-infrastr...

but to be fair, storage is core to Dropbox's business... this is not true for most companies.

disclaimer: I work for Dropbox, though not on Magic Pocket.

Re: Google Cloud Is Down

#588
post #82

Earlier quoted context omitted.

>nothing is lost except time

Can't use my Nest lock to let guests into my house. I'm pretty sure their infrastructure is hosted in Google Cloud. So yeah... definitely some stuff lost.

They weren't wearing Batman t-shirts were they?

http://www.ktvu.com/news/mistaken-identity-nest-locks-out-ho...

Re: Google Cloud Is Down

#589
post #488

Earlier quoted context omitted.

They WILL absolutely block and suspend all accounts indefinitely. They have terminated accounts for credit card failing transactions. I really wanted to try out their new autoML but I was paranoid of entering my credit card and getting banned from Google

oh man....so ALL of my gmail gets banned? this is FUCKED. its aking to holding my youtube and google play accounts hostage.

I moved off of gmail after reading stories of people getting locked out of their google accounts and how difficult it made things due to email basically being an internet passport, so I sympathise with your fear here.

With that said, If I delivered you services and then you credit card chargebacked me, I'd cut all relations with you as well.

Re: Google Cloud Is Down

#590
post #352

Earlier quoted context omitted.

How? At least in EU services bought from overseas are subject to reverse charge, i.e. self-assessment of VAT (Article 196 of https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:02... ). Though note that if you are an EU AWS customer, you are not buying from outside EU, you are buying from Amazon's EU branches regardless of AWS region. If Amazon has a local branch in your country, they charge you VAT as any loca…

My experience is with Canadian HST. Since AWS built a DC in Canada, I’m paying HST on my Route53 expenses, but not on my S3 charges in non-Canadian DCs. I’m not an HST registrant (small supplier, or if you’re just using services personally), so there’s nothing to self-assess. Even if self-assessment was required, you get some deferral on paying (unless you have to remit at time of invoice?).

Makes sense.

I believe it works differently in EU (i.e. US DCs taxed) as per Article 44 the place of supply of services is the customer's country if the customer has no establishment in the supplier's country.

Post reply on HN