Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tell HN: Google Cloud suspended our production projects at 1am on Saturday

news.ycombinator.com

Post reply on HN
Print view View original

81–90 of 531 posts

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#81

Post by oars »

reeeeee wrote: post #50
silisili wrote: post #36

Seeing all these horror stories, I can't help but wonder when people are going to switch back to on prem, or at least some hybrid. It's pretty apparent we can't trust cloud providers...

I'm not so sure. Aren't we having a bit of negativity bias here, as we mostly hear about the negative events while there are probably countless successful integrations with cloud providers.

Exactly. This is truly negativity bias.

Look at all the banks shifting their infra to the cloud. Haven't heard anything bad happen from that. And their uptime and business requirements are as stringent as anyone else, even further scrutinized by regulators and auditors.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#82

Post by mkl95 »

lovelearning wrote: post #41
marban wrote: post #21

never use google cloud systems for production is a strong statement based on one random incident. CGP customer since launch 2008 (when it was App Engine) and spend around $3k/m on it (Also using AWS and Heroku). Never had a single issue but CS responses vary a lot depending on how you funnel requests.

I don't think dismissing such incidents as random incidents is a good idea. Although crimes and thefts are rare, all developed societies invest millions into law enforcement and justice systems to measure and mitigate them. Although device and equipment failures are rare, both private and government systems exist to address them fairly. It seems like it's only in the tech industry that statistical insignificance of f…

> I don't think dismissing such incidents as random incidents is a good idea.

If I had €1 for every time a politician has dismissed some incident as a random incident I could probably buy a high-end MacBook.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#83

Post by yoro46 »

sofixa wrote: post #74
paganel wrote: post #33

The law should come hard on this sort of shenanigans, but hitting on Big Tech has already become a political issue in the US, Europe is, in the end, too afraid to do it (bar some relatively minor extra taxes that Big Tech is all to happy to pay as long as it's not made legally liable in other ways), and here we are, with crazy stories like this one (one of many).

> Europe is, in the end, too afraid to do it Take a look at the Digital Markets and Digital Services Acts on top of the already active GDPR.

Well, the GDPR isn't there to fine companies for doing the wrong thing. A company's first violation rarely results in fines or disciplinary action. In any case, I do agree that the EU seems to move quicker and act stricter than other regions in regulating big tech companies.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#84

Post by matsemann »

paganel wrote: post #33

The law should come hard on this sort of shenanigans, but hitting on Big Tech has already become a political issue in the US, Europe is, in the end, too afraid to do it (bar some relatively minor extra taxes that Big Tech is all to happy to pay as long as it's not made legally liable in other ways), and here we are, with crazy stories like this one (one of many).

> Europe is, in the end, too afraid to do it

Hmm, I feel this is opposite of what people normally complain about here. Every time EU does something about big tech, HN users will pop up saying it's just because they're jealous and wants to harass US companies. And other's saying the US are just afraid of hurting their own companies and look the other way so they can grow big.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#85

Post by mcny »

rglullis wrote: post #72
deelowe wrote: post #62

Earlier quoted context omitted.

Because it’s regressive. We need to fix the issues, not throw the whole thing out.

These "issues" only exist because of the scale and reach of Corporations. You can not fix "too big to fail" issues unless you stop letting these institutions to grow too big in the first place. I'm yet to hear a single convincing argument of why we need to have organizations of such a large scale nowadays. Could you make a case of what we would be missing if we just "threw the whole thing out"?

I propose another option: unless you can show clear written instructions, the ceo and the board are personally criminally responsible for the acts of their agents, contractors, and employees at the course of their duty.

If your branch manager incorrectly adds your teller to an industry wide list of do not hire, the board and CEO are personally criminally responsible for it. No hiding behind the corporate veil. I don’t know how to prove whether someone acted in their own and not on the instructions of the employer though. What I’m afraid of is equifax will simply create many companies and divvy up it into equifax backend web services llc that has fewer than 150 employees.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#86

Post by michelb »

Croftengea wrote: post #44
jamespwilliams wrote: post #19

The same is true of DigitalOcean, fwiw. Shutting down machines used in production with no notice, outside working hours. I don’t know why these companies don’t care - they’re massively shooting themselves in their feet. Incidents like this turn customers off for life.

Care to share more info please? Was it because card didn't go through? I've got some important stuff there.

I'd like some more info as well. Only case I know was from someone who didn't see the emails about issues with their payment.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#87

Post by dustinmoris »

reeeeee wrote: post #50
silisili wrote: post #36

Seeing all these horror stories, I can't help but wonder when people are going to switch back to on prem, or at least some hybrid. It's pretty apparent we can't trust cloud providers...

I'm not so sure. Aren't we having a bit of negativity bias here, as we mostly hear about the negative events while there are probably countless successful integrations with cloud providers.

Yes, if you'd compare all horror stories of people having huge downtimes because their on-prem system collapsed vs. people having an issue with their cloud provider then we'd very quickly realise again why the cloud has taken us by storm.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#88

Post by andrewinardeer »

I know I'm going to come off as a Google apologist, however, I'm leaning towards there being more to the story than what you are saying.

The previous month's billing didn't 'went through' and you are unable to zero in on whether this is a Google issue or a you issue.

I get that it is easier to complain on the internet and often cathartic do so as a coping mechanism.

Having an account suspended because of a billing issue is not exclusive to Google.

Have you moved your projects off GCP now as voting with your wallet would be the sensible thing to do. Until you encounter a billing issue with AWS and move again to Azure and then to DO.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#89

Post by ramraj07 »

invalidname wrote: post #80

This calls for a "me too" moment where everyone shares their Google is terrible and I'll never use them again. Here are a couple of my favorites from our company: https://medium.com/hackernoon/why-and-how-we-left-app-engine... https://dev.to/codenameone/google-play-kafkaesque-experience... There's this story from a couple of days ago which is shocking: https://news.ycombinator.com/item?id=32538805 Google is a terribl…

The most interesting part is how all this awfulness seems to stem purely from apathy.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#90

Post by belorn »

rglullis wrote: post #20
emsy wrote: post #16

Earlier quoted context omitted.

Regulation, full stop. The reason Big tech makes so much profits is because they have no accountability and at their scale, social shaming doesn’t work.

Right. Heavily-regulated industries like banking, auto and healthcare are known for being so much better at treating its customers like human beings...

Unregulated banking tend to have a bit more ponzi schemes, pump and dump, and money laundering than regulated banking.

Unregulated auto tend to have a bit more lemon markets than regulated auto.

Unregulated healthcare tend to have a bit more snake oil, blood letting and cocaine than regulated healthcare.

Unregulated food sector tend to have a bit more Listeria and Salmonella then regulated food sector.

No regulation are not know for being that nice either, which is to say that some regulation is good and some regulation is too much, but one can't dismiss regulation as just being bad.

Post reply on HN