Earlier quoted context omitted.
[flagged]
The is in context of B2B, which meta has a huge ecosystem and often rips away a companies revenue for hidden reasons
Incident Report: May 19, 2026 – GCP Account Suspension
171–180 of 279 posts
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#172Earlier quoted context omitted.
If you are unable to use IaaS directly. You need to accept that your service might be down. Even if you use AWS and the like, if you aren't building your app with redundancy across multiple AZs, then you'll have some downtime occasionally. And even if you do build redundancy with multiple AZ, some services might fail anyway as AWS is not entirely isolated. So you might have downtimes. So just accept downtimes and use…
The advantage of going with AWS is that when us-east-1 goes down, half the internet goes down so you don't have to defend why you had a service outage.
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#173Unfortunately we had to make emergency migration off to Azure yesterday due to this. Thankfully our DB was not hosted on Railway and we were back up in a couple hours. As much as we loved the simplicity they provided us, there's just been too many mishaps and shortcomings for us to continue running a B2B enterprise app on their infrastructure. Sad day :(
Azure suspended your account as well?
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#174Earlier quoted context omitted.
In the case of them giving AI admin credentials to delete their production database, and it deleted their production database: that's on them. They were the only ones who put the admin account credentials into their AI. Then they took no personal responsibility. That definitely damaged their reputation. Here, they are taking at least some responsibility. Props to them on improving. Also, GCP does indeed have serious…
Did Railway give admin credentials to delete their production database? My memory of the incident is that a customer of Railways used an AI tool to delete their production database, and then blamed Railway for it. The customer was the one who put their own account credentials into their own AI, not Railway
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#175Earlier quoted context omitted.
They have not explained WHY their account was suspended. That's the most important part, imo. Cloud Providers don't suspend entire accounts for no reason.
The cloud provider in question - GCP - who also deleted a 125 billion dollar company's entire account on accident?
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#176This should be a warning to anyone running GCP. They suspend accounts left right and centre without even thinking about what they're doing. It seems like they use Gemini 3.1 Pro to run their production decisions. TK has a history of absolutely destroying the culture of the place like in OCI and has done something similar in GCP from what I've heard. GCP and Google are completely different entities with how they work.…
Hasn't theGoog acted this way of quick to suspend accounts well before Gemini? I like to bash on LLMs as much as the next guy, but this seems very much like the memory of a gold fish. Or, you are just too young to remember pre-LLMs???
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#177"Finally, we are in planning to remove Google Cloud services from our data plane’s hot path, and keeping them only for secondary/failover." That's pretty clear. Google can no longer be trusted as a B2B service provider.
Railway don't have a great reputation for building scalable systems (effects of vibe coding?). It's worth waiting for Google's response before jumping to conclusions. They can move to Azure/AWS/own datacenter, but there's a good chance this will repeat in a few months.
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#178There is no justification given on why this action was incorrect. It's possible they actually did something wrong.
Re: Incident Report: May 19, 2026 – GCP Account Suspension
#179Earlier quoted context omitted.
The cloud provider in question - GCP - who also deleted a 125 billion dollar company's entire account on accident?
What company?