Live data from Hacker News

Tell HN: Google Cloud suspended our production projects at 1am on Saturday

news.ycombinator.com

451–460 of 531 posts

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#451
post #124

A few years ago I was working at a startup and we had just started moving some stuff over from AWS to GCP. Things were going pretty good with GCP until one day they pulled the plug on everything with no explanation. It turns out that our company credit card details had been fraudulently used without our knowledge. The criminal had decided to use the card to buy Google Ad Words or something like that - this is the sam…

I hear way too many stories like this about Google products. Whether it's Youtube, AdWords, GCP, or anything else - you get blackholed by them and there's zero recourse. I just can't trust Google for something like running production services.

Thing is they have products that we use personally and all of those are linked to GCP. So if we do a chargeback on GCP billing that was by error, nobody to respond, they have the potential to impact ALL of our personal Google accounts.

Doesn't get more dystopian than this. Fuck Google.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#452
post #18
post #12

It sucks that they gave you conflicting information that resulted in this but I wouldn't trust having my cloud infrastructure payments be handled using a single credit card. If you have a spend of over $2500/mo you can apply for invoiced billing directly from Google or if you have less than that you can contact a GCP reseller partner to get invoiced by them. Some GCP reseller partners also have a close relationship w…

$2500 is honestly not that much. Google cloud dropped the ball on this and shouldn’t need to be handled with special relationships

Not much for you but a lot for others. This type of arrogance really doesn't belong in this space. Maybe you spend $25,000? $250,000? peanuts to large companies so its okay that Google cloud drops the ball on you?

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#453

Earlier quoted context omitted.

I found the Azure reps to be completely useless for any of the actual problems. I worked for couple of really big enterprises, one of which had such a high commitment that Azure sent two engineers to sit with the teams working on their cloud. Highest level Enterprise support .. and yet for actual non-obvious problems it took them a month to reply with: can't help you with this, you must be doing it wrong. This was te…

I worked for one of Azure's biggest customers and our account management teams were fantastic. A few individuals were some of my favorite people I've worked with. That's where all the talent in the Azure support org goes- promoted to the biggest contracts.

Yes the big fish get attention and the small fish get ignored. Welcome to the B2B universe. If you're a small business relative to the scope of your counterparty, you generally won't get good service or have any leverage.

Seek out resellers or providers who are closer to yourself in size. You want it to hurt a bit if they lose your business. Of course you can go too far the other way as well, if you're a large client of a small company you'll probably get good service but they will be living parasitically off of you which isn't healthy and they may not be able to respond quickly enough if your needs grow.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#454

Earlier quoted context omitted.

What would someone break Google up into, ad and vertisements? If you look at their quarterly reports you'll see that they are almost entirely based around one product.

You could cut out ads from the rest. And make Google buy ad space from Foogle Search.

Of the viable companies, each would still be a monopoly.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#455
post #163

Earlier quoted context omitted.

It's like looking both ways when crossing the road despite the light telling you that you can go. Sure you have right of way and if a car hits you, it's their fault. But at the end of the day, you are the one getting hit by the car. Google is at fault for how they handled it, but the parents comment is still good advice for anyone reading this thread.

How are you supposed to trust a company who told you they wouldn't screw you because of their own error, then screwed you anyway? Having a relationship with them doesn't matter if they still can't be trusted to do business. The type of payment method you use is not a factor that plays into whether you can trust your vendor.

As I mentioned elsewhere, this is a sign of imbalance in the relationship. If you are too small to matter to Google or even to your account rep at Google, then you should not be using them.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#456

A suggestion for engineers that lack business experience. As soon as your project grows beyond the non-hobby scale and starts making real money, invest some time to reach out to company providing the services that keep it alive and find an account manager that will take care of you. We're a Google customer and of course we had our fair share of issues (btw: it's the same with Azure, based on our experience), and we a…

Someone should invent a sue-as-a-service ("SaaS") where you can just sue companies in a couple clicks if they shutdown your services or have bad account management that leads to downtime.

Considering the problems are repetetetive, the legal documents can easily be templated and reused and the victim would not have to waste much time or effort in court. Scale the lawyers just like we scale cloud instances.

Maybe even have a way to programmatically sue based on automated downtime metrics.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#458

A suggestion for engineers that lack business experience. As soon as your project grows beyond the non-hobby scale and starts making real money, invest some time to reach out to company providing the services that keep it alive and find an account manager that will take care of you. We're a Google customer and of course we had our fair share of issues (btw: it's the same with Azure, based on our experience), and we a…

lol. trying to get an actual human being at google to talk to you is an insane task if you’re not a substantial sized account.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#459
post #444
post #395

Earlier quoted context omitted.

Several years back I wanted to try my hand at making an Android app and putting it in the Play Store. I knew ahead of time from reading all the horror stories that it's best to make a second dedicated developer Google account because once you turn an account into a developer account you're basically painting a target on your back to be randomly deleted by the powers that be. Additionally, not sure if this is still th…

The last time I tried to make a new Google account it required a valid phone number, so this might require getting a second phone line these days. I wouldn't trust Google to only disable one account if there is a related one using the same number.

Even that won't protect you from being banned if Google ever infers that the two accounts are related.

I just refuse to use Google for anything other than mail at this point.

Re: Tell HN: Google Cloud suspended our production projects at 1am on Saturday

#460

Earlier quoted context omitted.

I hear way too many stories like this about Google products. Whether it's Youtube, AdWords, GCP, or anything else - you get blackholed by them and there's zero recourse. I just can't trust Google for something like running production services.

"can't trust Google" There, fix that for you. If it's mission-critical, there are better customer-focused solutions out there than Google. Despite their massive brain power, they just can't seem to get dealing with users correctly.

  they just can't seem to get dealing with users correctly
I guess internally it is considered a major failure if they ever have to deal with a user vs their automation incorrectly banning users without recourse. :-/
Post reply on HN