Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Incident Report: May 19, 2026 – GCP Account Suspension

blog.railway.com

Post reply on HN
Print view View original

151–160 of 279 posts

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#151

Post by praptak »

guluarte wrote: post #107
shwetanshu21 wrote: post #47

This should be a warning to anyone running GCP. They suspend accounts left right and centre without even thinking about what they're doing. It seems like they use Gemini 3.1 Pro to run their production decisions. TK has a history of absolutely destroying the culture of the place like in OCI and has done something similar in GCP from what I've heard. GCP and Google are completely different entities with how they work.…

This feels like google applying the same anti-spam mindset everywhere: detect risk, ban first, ask questions later.

It's pretty stupid that big customers like Railway are not somehow protected from this.

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#152

Post by skywhopper »

malfist wrote: post #70
nthypes wrote: post #60

Earlier quoted context omitted.

Meta is no different. I know a company that had their OAuth app on Meta rendered completely unusable just because one of their employees (a dev) had their personal Facebook account banned by Meta for no reason. They tried to escalate it multiple times but got nowhere, lol. Meta is even worse because accounts need to be 'personal'; if you have a Business Manager, the users added to it are all tied to their personal Me…

[flagged]

A huge number of small businesses have no Internet presence beyond their Facebook and Insta pages, so … yes they are extremely relevant to a discussion about the risk to small business of flaky hyperscalers.

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#153

Post by zuzululu »

ryanSrich wrote: post #11

Question: for a smaller SaaS tool, or even internal product. If a team doesn't want to manage AWS or another IaaS provider, what are the best alternatives for the following 1.) Vercel - having a bad month 2.) Supabase - having a bad month 3.) Railway - now having a bad month

Why does nobody consider that you can buy a baremetal box or even a VPS and that will get you very far without paying a metered fee

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#154

Post by shwetanshu21 »

"Railway owns our vendor choices, and we ultimately own this one. Your customers don't care whether the failure was Google or Railway; they see your product. Your uptime is our responsibility, and we'll keep delivering on it."

Kudos to them for acknowledging it and not doing PR speak. It shows it was an architectural failure from their part of trusting GCP, and they are working to fix it. Should they have seen it coming? Yes. But better late than never.

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#155

Post by coreylane »

londons_explore wrote: post #119
JCTheDenthog wrote: post #77

Earlier quoted context omitted.

Unfortunately the cloud providers also rarely if ever tell you the reason.

My guess would be the credit card expired.... If it were something out of Railways hands, I think they would say something like "We have not yet identified the reason for the suspension, and are awaiting a response from Google".

No one pays $2m invoices with credit cards.

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#156

Post by nightpool »

ImPostingOnHN wrote: post #120
Jgrubb wrote: post #2

Railway has not had the best month in the tech press have they? And in both cases it was an automated process belonging to some other party that put them there, damaging their reputation. I was going to talk to our google rep about their killing the Gemini cli but this is way more concerning.

In the case of them giving AI admin credentials to delete their production database, and it deleted their production database: that's on them. They were the only ones who put the admin account credentials into their AI. Then they took no personal responsibility. That definitely damaged their reputation. Here, they are taking at least some responsibility. Props to them on improving. Also, GCP does indeed have serious…

Did Railway give admin credentials to delete their production database? My memory of the incident is that a customer of Railways used an AI tool to delete their production database, and then blamed Railway for it. The customer was the one who put their own account credentials into their own AI, not Railway

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#157

Post by shwetanshu21 »

JohnMakin wrote: post #79
shwetanshu21 wrote: post #47

This should be a warning to anyone running GCP. They suspend accounts left right and centre without even thinking about what they're doing. It seems like they use Gemini 3.1 Pro to run their production decisions. TK has a history of absolutely destroying the culture of the place like in OCI and has done something similar in GCP from what I've heard. GCP and Google are completely different entities with how they work.…

All google products work like this. Should never be used for anything critical.

Yeah, sadly know that from being burned from one of their depreciations. In fact, 2-3. But you live and you learn. And it is better to learn from other's mistakes always.

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#158

Post by rapfaria »

JCTheDenthog wrote: post #77
tjwebbnorfolk wrote: post #56

Earlier quoted context omitted.

They have not explained WHY their account was suspended. That's the most important part, imo. Cloud Providers don't suspend entire accounts for no reason.

Unfortunately the cloud providers also rarely if ever tell you the reason.

Not defending them. but wouldn't it be a legal nightmare if they did?

Re: Incident Report: May 19, 2026 – GCP Account Suspension

#160

Post by thebruce87m »

shwetanshu21 wrote: post #47

This should be a warning to anyone running GCP. They suspend accounts left right and centre without even thinking about what they're doing. It seems like they use Gemini 3.1 Pro to run their production decisions. TK has a history of absolutely destroying the culture of the place like in OCI and has done something similar in GCP from what I've heard. GCP and Google are completely different entities with how they work.…

> Don't expect Google quality from the name.

It sounds exactly like what I have experienced in terms of Google quality over the decades.

Post reply on HN