Live data from Hacker News

Tell HN: Google Cloud suspended our production projects at 1am on Saturday

news.ycombinator.com

41–50 of 531 posts

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#41
post #21

never use google cloud systems for production is a strong statement based on one random incident. CGP customer since launch 2008 (when it was App Engine) and spend around $3k/m on it (Also using AWS and Heroku). Never had a single issue but CS responses vary a lot depending on how you funnel requests.

I don't think dismissing such incidents as random incidents is a good idea.

Although crimes and thefts are rare, all developed societies invest millions into law enforcement and justice systems to measure and mitigate them.

Although device and equipment failures are rare, both private and government systems exist to address them fairly.

It seems like it's only in the tech industry that statistical insignificance of failures is assumed and then wielded as justification to avoid even minimal levels of accountability.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#42
post #18

Earlier quoted context omitted.

$2500 is honestly not that much. Google cloud dropped the ball on this and shouldn’t need to be handled with special relationships

All of the relationships I have with suppliers are handled by an account manager at the supplier who I can call to get things sorted out. This is normal. Why should a business relationship with Google (or any other cloud service) be any different? I don't use GCP but if I was going to start, I would ensure that I have a person to call or its a non-starter.

> Why should a business relationship with Google (or any other cloud service) be any different?

Depends on the size of the account surely? Maybe there's some support person to talk to, but there's plenty of services I subscribe to fo $10-100/month and I dont have an account manager for any of them.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#43
post #31

Earlier quoted context omitted.

Right. Heavily-regulated industries like banking, auto and healthcare are known for being so much better at treating its customers like human beings...

Yup. Too big to fail sucks just as hard in banking. Google needs to be broken up as badly as banks do. It's a battle that keeps on coming up and here it is again.

Why stop at Google? Why don't we simply get rid of the idea of the mega corporation?[0]

[0]: https://news.ycombinator.com/item?id=31317641

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#44

The same is true of DigitalOcean, fwiw. Shutting down machines used in production with no notice, outside working hours. I don’t know why these companies don’t care - they’re massively shooting themselves in their feet. Incidents like this turn customers off for life.

Care to share more info please? Was it because card didn't go through? I've got some important stuff there.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#45
post #25

Earlier quoted context omitted.

Do we see much of this for AWS? Asking for a friend...

With AWS the problems I heard was your bill getting really really high unexpectedly.

TBF that can happen with any of the big cloud providers.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#46
The company I work for has forbidden the use of Google and their services (if possible) such as GCP etc. due to how they treat their customers. In particular, there never seems to be any human being that you can talk to and find out what you need to do to fix the issue. We do not want the same to occur to our production systems if there is an overflow from a Play Store ban to GCP etc. The business risk is too high when you rely on Google's services.

Some examples:

Suspended GCP even when everything in order - https://news.ycombinator.com/item?id=32547912

Ban app even when competitors are similar - https://www.vice.com/en/article/z3vdpj/google-play-store-ban...

Play Association ban - https://old.reddit.com/r/androiddev/comments/ts6jfg/google_h...

Ban due to wrong wording - https://twitter.com/hermaritz/status/1371383715381805061

Terraria banned - https://twitter.com/Demilogic/status/1358661840402845696

New project banned - https://medium.com/@amton15127/why-you-should-not-use-fireba...

Google bans company - https://www.reddit.com/r/tifu/comments/8kvias/tifu_by_gettin...

Google bans mail - https://talkingpointsmemo.com/edblog/a-serf-on-googles-farm

Ban app for communicating changes during covid - https://news.ycombinator.com/item?id=23221447

Adwords ban - https://news.ycombinator.com/item?id=23224791

Serverpunch bad support - https://news.ycombinator.com/item?id=17431609

Delete app - https://news.ycombinator.com/item?id=20826618

Google bans game with pandemic - https://news.ycombinator.com/item?id=23229073

Google bans dev with no recourse - https://news.ycombinator.com/item?id=15197357

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#47
post #25

Earlier quoted context omitted.

Do we see much of this for AWS? Asking for a friend...

With AWS the problems I heard was your bill getting really really high unexpectedly.

but they always find a solution to it. i've spun up redshift instances to play around that racked up thousands by accident, and they forgave them in a snap.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#48
post #21

never use google cloud systems for production is a strong statement based on one random incident. CGP customer since launch 2008 (when it was App Engine) and spend around $3k/m on it (Also using AWS and Heroku). Never had a single issue but CS responses vary a lot depending on how you funnel requests.

I don't think dismissing such incidents as random incidents is a good idea. Although crimes and thefts are rare, all developed societies invest millions into law enforcement and justice systems to measure and mitigate them. Although device and equipment failures are rare, both private and government systems exist to address them fairly. It seems like it's only in the tech industry that statistical insignificance of f…

> It seems like it's only in the tech industry that statistical insignificance of failures is assumed and then wielded as justification to avoid even minimal levels of accountability.

Stealing this, it's far more broadly applicable than just to this sort of billing issue.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#49

The same is true of DigitalOcean, fwiw. Shutting down machines used in production with no notice, outside working hours. I don’t know why these companies don’t care - they’re massively shooting themselves in their feet. Incidents like this turn customers off for life.

they are big and you are small. It's like walking over ants.

Ants pay the bill!

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#50

Seeing all these horror stories, I can't help but wonder when people are going to switch back to on prem, or at least some hybrid. It's pretty apparent we can't trust cloud providers...

I'm not so sure. Aren't we having a bit of negativity bias here, as we mostly hear about the negative events while there are probably countless successful integrations with cloud providers.
Post reply on HN