I’m a new customer and have been falling in love with Railway over the last 2 weeks, but this is quite the wake up call.
Been a customer with them for over a year now, small incidents here and there but never anything this major.
Incident Report: Railway Blocked by Google Cloud [resolved]
71–80 of 381 posts
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#72It has been 0 days since GCP has taken down a startup (again). You see this at least once a year. Never heard of this from AWS or Azure. In all seriousness, this is why we don't use them. They have the most ergonomic cloud of the big three, then absolutely murder it by having this kind of reputation.
AWS normally contacts you first.
They better do. What is google doing?
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#73[dead]
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#74[dead]
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#75At this point you can’t trust Google anymore, it keeps breaking things. Imagine having Google AI do this thins automatically. Will have apocalypse in in a day.
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#76Wait… railway runs on GCP? Didn’t they make a whole thing about not “building a cloud on top of another cloud?” Or did they just mean that they’re not renting VPSs but only metal from the cloud provider? In my mind I was so excited that there was another provider not just paying one of the hyperscalars but at a minimum colocating and owning more of their stack. https://blog.railway.com/p/heroku-walked-railway-run
from the blog linked via Wayback Machine. "From Day 1, we had this notion at the forefront. The other notion that we have intuited is that you can’t build a cloud on another cloud. We have devoted years of practice running our own metal (and playing well with other clouds) to make sure that Railway’s business, which invariably becomes your customer’s business, is as rock solid as possible."
That’s strange, when I interviewed with the founder a few years ago he told me they were on AWS wanting to move to firecracker.
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#77This could kill a startup. I really don't like Google's automated and silent account murder functionality.
There’s no way this was automated or silent.
The only reasonable explanation is Railway lost control of their estate and something was happening that warranted a group of humans to decide flipping the kill switch was the best of a set of bad alternatives.
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#78Railway is back, but I’m not sure if I can trust keeping my projects there, so I’m going to migrate to another company.
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#79I’ve seen a few smug “all your eggs in one basket” comments here. I’m aware of some companies hosting their own metal and infra, but I’m not aware of large companies mitigating risk by hosting on separate cloud providers as a fallback mechanism. We might disagree with cloud provider choice, or think they should have been hosting their own metal, but that’s still an “all your eggs in one basket” choice, right? Heck, t…
Just google multi-cloud. Yes. It's a thing.
99% of multi-cloud is fake though. True multi-cloud is incredibly rare.
Re: Incident Report: Railway Blocked by Google Cloud [resolved]
#80It has been 0 days since GCP has taken down a startup (again). You see this at least once a year. Never heard of this from AWS or Azure. In all seriousness, this is why we don't use them. They have the most ergonomic cloud of the big three, then absolutely murder it by having this kind of reputation.
Yep, agree 100%. Such a stupid move on their behalf.