Live data from Hacker News

GCP Incidents

blog.railway.app

71–80 of 167 posts

Re: GCP Incidents

#71
post #64
post #62

I know AWS isn't cool or sexy, but shit works.

It’s sad to see people rediscovering that GCP is not a serious product over and over again.

What's your personal experience with it? We've been on the platform for almost eight years. Three clusters, hundreds of compute VMs, four or five public and private DNS zones, 10+ cloud sql dbs, about the same number of memorystore and firebase instances. We just don't see these issues as related in the OP, and when we do have problems support has been fast and helpful. Not to gainsay their experience, since it was obviously frustrating, but truthfully you can find similar stories about all compute providers.

Re: GCP Incidents

#72

HOW TO CHOOSE A CLOUD PROVIDER * AWS: you will pay to have stuff work properly and you like having customer service * Azure: you hate yourself, you're running Windows or both * Google: you're cheap enough that basic functionality is an optional extra * Oracle: lol * Hetzner: cheap, good service, the finest pets in the world, no cattle

What about DO?

You should always reach out to use Digital Ocean, Linode, Vultr as your starting point. Aws and the gang are mega mega expensive compared to what you pay for a vps. If you require services beyond compute, database and storage, then use the big names. Otherwise save yourself headache with complexity, unpredictable and absurd costs.

Please don't use AWS especially as a startup, you are going to kill yourself paying for compute, database and egress that is multiples times what you get from a vps. AWs is NOT cheap

Re: GCP Incidents

#73
post #2

When they say moving are off Google Cloud services to bare metal, where do they plan to move?

A data centre or (less likely) their own office. This was the way things were done not that long ago ;)

Re: GCP Incidents

#74

You should've migrated many months ago, if a cloud provider forces you to build your own networking or registry, you shouldn't use that cloud provider.

Well for folks building out cloud infrastructure, building your own networking stack and registry is a good way to achieve platform independence, without which you'll be left at a disadvantage and vulnerable to the whims of cloud providers who may or may not extend volume discounts, thus indirectly harming your ability to compete.

Doesn't the requirement of "building your own networking stack" outcompete with "just colocate"?

I would assume that the skills required for building your own network ist just as high as hosting your own hardware. But I don't have any data point, so just a wild guess.

Re: GCP Incidents

#75
post #68

HOW TO CHOOSE A CLOUD PROVIDER * AWS: you will pay to have stuff work properly and you like having customer service * Azure: you hate yourself, you're running Windows or both * Google: you're cheap enough that basic functionality is an optional extra * Oracle: lol * Hetzner: cheap, good service, the finest pets in the world, no cattle

>Azure Or you have big enterprise customers that have a grudge against Amazon and Google and refuse to use anything else.

Azure is great if you stick to the three golden oldies: DTU-based SQL, app service and service bus. Maybe table storage if you're feeling lucky. Anything else leads to pain and $$$, because it's likely that no one at Microsoft is being forced to use it.

Re: GCP Incidents

#76

HOW TO CHOOSE A CLOUD PROVIDER * AWS: you will pay to have stuff work properly and you like having customer service * Azure: you hate yourself, you're running Windows or both * Google: you're cheap enough that basic functionality is an optional extra * Oracle: lol * Hetzner: cheap, good service, the finest pets in the world, no cattle

> * Hetzner: cheap, good service, the finest pets in the world, no cattle

You can absolutely do cattle with Hetzner. They support imaging and immutable infrastructure. They don't have a native auto scaling equivalent, but if you're using Kubernetes, they have a cluster autoscaler: https://github.com/kubernetes/autoscaler/blob/master/cluster...

Hetzner Cloud's biggest gap for me right now is secure VMs: they don't support encrypted disks, UEFI, secure boot, or TPMs (and certainly nothing like AMD SEV). You can get a fat bare metal Ryzen box through Robot and DIY though.

Re: GCP Incidents

#77
I work at a company that spends billions on AWS and we intentionally have minimal gcp deployments and ban compute there because of how unreliable gcp is and how awful (outsourced) their support is. Gcp has excellent products but garbage operations. Who is running that clown show? It could have easily been the #2 cloud if they knew what they were doing

Re: GCP Incidents

#78

You should've migrated many months ago, if a cloud provider forces you to build your own networking or registry, you shouldn't use that cloud provider.

That was the first thing that struck me, the 'workarounds' stagger belief, but they seem to be casually dropped in (?). If I were in a situation where my company was contemplating implementing building our own registry/network stack, then the benefits of using a cloud provider are gone, and I would have considered moving to another provider... not saying "I can fix him". This feels like a sunken cost perhaps that is…

I would bet that they were thinking about colocating and would need to have secured intra-service communication anyhow. In Google this is transparent but at a (probably yet identified facility) it'd be up to them to provide.

Re: GCP Incidents

#79

Earlier quoted context omitted.

I hear this over and over, but what is the alternative cross-platform stack for building rich local GUI apps? Qt?

I’d say Flutter, a GUI framework backed by Google and it’s open source. I’ve recently ported over a popular project called “llama.cpp” to Dart (language behind Flutter) and I’ve recently made YT video’s showing it running natively on macOS, Linux, Android, iOS, iPadOS and next up is Windows. The official Ubuntu installer is made with Flutter too nowadays. But to be fair, last time I tried QT was somewhere in 2018, it…

Is the port open-source? I'd like to try it, if so.

Re: GCP Incidents

#80
"On December 1st, at 8:52am PST, a box dropped offline; inaccessible. And then, instead of automatically coming back after failover — it didn’t. Our primary on-call engineer was alerted for this and dug in. While digging in, another box fell offline and didn’t come back"

This makes no sense. A machine restarted and you had catastrophic failure? VMs reboot time to time. But if you design your setup to completely destroy itself in this scenario, I don't think you will like a move to AWS, or god forbid, your own colo.

Post reply on HN