Live data from Hacker News

Our production servers were suspended by Google Cloud

onvoard.com

61–70 of 189 posts

Re: Our production servers were suspended by Google Cloud

#61

“Moving Forward. Starting today, I will be making plans to move everything to AWS.” I laughed when I read this because it’s presenting moving to AWS as a completely different future. The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket. I would say don’t put your business in the hands of a single cloud vendor. Either exit the cloud or go multi c…

> The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket.

In that case, the vast majority of enterprises are negligent.

Re: Our production servers were suspended by Google Cloud

#62
post #15
post #3

You expect not to be treated the same way by AWS? Am I missing something here?

AWS don't do shutdowns over a email for missing details. Even when they have issue over non payment, they wait at least 3 months, gives calls, sends follow up emails and for the actual shutdown they disable the network. the servers will continue to run for sometime. so if the payment is made it comes back without many issues.

True, but this wasn't a missed-payment shutdown; it's a KYC-compliance shutdown.

Still, I'd bet even money Amazon does the messaging better than Google on something like that.

Re: Our production servers were suspended by Google Cloud

#64
It seems like Google has burned up nearly all the goodwill it used to have years ago. They now have a nearly broken search engine that needs the term “Reddit” appended to get anything useful, and you routinely hear horror stories about them acting badly without any regard to users. I hope they get disrupted and replaced by bing chat and others asap. The only thing that will possibly teach them a lesson is if their business results start rolling over in a big way and large activist investors can cause the board to realize they need to replace Sundar with someone who gets that radical change is needed.

Re: Our production servers were suspended by Google Cloud

#65

“Moving Forward. Starting today, I will be making plans to move everything to AWS.” I laughed when I read this because it’s presenting moving to AWS as a completely different future. The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket. I would say don’t put your business in the hands of a single cloud vendor. Either exit the cloud or go multi c…

I disagree.

I’ve hosted on AWS for ages. They don’t do this. We didn’t pay the bill for two months once because the owner of the card left. No problems. This was a small spender outfit. They could have thrown us on the street as we were a rounding error. Now we’re a big spender and we still forgot to pay them sometimes (sorry Bezos)

But some of your point is worth considering. Design for portability should the worst happen (you are cut off due to geopolitics or other problems) or somewhere else turns out to be a better deal. Stick to IaaS and portable services only.

For the moment I trust AWS though.

Re: Our production servers were suspended by Google Cloud

#66

“Moving Forward. Starting today, I will be making plans to move everything to AWS.” I laughed when I read this because it’s presenting moving to AWS as a completely different future. The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket. I would say don’t put your business in the hands of a single cloud vendor. Either exit the cloud or go multi c…

The difference is when something goes wrong at AWS someone picks up the phone, fixes your stuff, apologizes profusely, and give you a credit. Mutlicloud is great but somewhat complicated to setup correctly. The value add of AWS is that Amazon has unusually good customer service.

It's, to some degree, built into the ethos of the company. Jeff Bezos' "customer obsession" mantra is quoted by professors in every MBA program from Arizona to Zagreb. Case-in-point, here's a compilation of him expressing it from 1999 to 2018: https://www.youtube.com/watch?v=DIrhVU04GHc

Amazon may not be particularly customer centric in terms of the products they allow on their market place, or AWS by the plate of spaghetti that is their various cloud offering, but their customer service division is great. You can get in contact with them in hours, and there's never a hesitation to give you refunds or credit if something goes wrong; something I can't say the same of when it comes to Microsoft or Google.

Re: Our production servers were suspended by Google Cloud

#67

“Moving Forward. Starting today, I will be making plans to move everything to AWS.” I laughed when I read this because it’s presenting moving to AWS as a completely different future. The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket. I would say don’t put your business in the hands of a single cloud vendor. Either exit the cloud or go multi c…

> The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket. In that case, the vast majority of enterprises are negligent.

> > The industry has moved beyond depending on a single cloud computing vendor. It’s negligent to put all your eggs in one basket.

> In that case, the vast majority of enterprises are negligent.

Vast majority of enterprises are not mission critical and their products don't need guaranteed downtime lower than 1min per year. What they need is a lower price, because people don't care about quality in that case but about costs.

Re: Our production servers were suspended by Google Cloud

#68
Make sure your decision to migrate to AWS is not an emotional one.

I had my own feud with AWS over a $60,000 bill and an enormous amount of hours spent by my team fighting crypto hackers after they took over one of our accounts and use very advanced scripts to create hundreds of large instances.

AWS has become very complicated to manage and at the same time the attacks to their infrastructure have increased exponentially.

If your company doesn't have a dedicated team to stay on top of AWS you'll be vulnerable to attacks like the one I experienced.

You simply can't count on the baseline configuration of your account and instances provided by AMS, you need advanced knowledge on how to secure your resources beyond basic stuff like MFA and monitoring.

And if you think AWS will have your back when shit hits the fan, lol good luck with that.

They will try to collect the bills while providing absolutely no support, reminding you about their Shared Responsibility Agreement.

They also expect you to fight the attacks.

I ended up spending months of work securing my services and cleaning my debt with AWS billing, to the point we almost went to court.

So again, you may have good reasons to migrate, just beware that AWS won't come free of hassle.

Re: Our production servers were suspended by Google Cloud

#69

Earlier quoted context omitted.

> The industry has moved beyond depending on a single cloud computing vendor. Given how much of the industry struggles when an AWS region goes down, this seems... unlikely.

How about “the industry should have moved beyond depending on a single cloud computing vendor.”?

That is a big difference from what you said.

The reality is that all serious outfits either host on AWS, or keep some level of AWS account at the ready, in addition to bare metal Linux servers in colos or hosting providers that they can move onto if needed.

Your statement is confusing simplicity and flexibility with multi-cloud. No one wants to deal with the confusing mix of random hosted services that 3 different cloud providers try to sell you, with one of them (Google Cloud) being this opaque horror story that the article is talking about.

Host on AWS, and mostly host your services on EC2. It's dead simple to migrate elsewhere if needed. You will likely never need to.

Re: Our production servers were suspended by Google Cloud

#70

Make sure your decision to migrate to AWS is not an emotional one. I had my own feud with AWS over a $60,000 bill and an enormous amount of hours spent by my team fighting crypto hackers after they took over one of our accounts and use very advanced scripts to create hundreds of large instances. AWS has become very complicated to manage and at the same time the attacks to their infrastructure have increased exponenti…

Did you get to a root cause of how the “crypto hackers” “took over” your account, or of what the “very advanced” scripts did?
Post reply on HN