Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GCP Outage

status.cloud.google.com

Post reply on HN
Print view View original

371–380 of 539 posts

Re: GCP Outage

#371

Post by terom »

rvnx wrote: post #187
VWWHFSfQ wrote: post #170

Earlier quoted context omitted.

There are multiple internet services down, not just GCP. It's just possible that this "Chemist" service is especially externally affected which is why the failures are propagating to the their internal GCP network services.

Absolutely possible. Though there is something curious: https://www.cloudflarestatus.com/ At Cloudflare it started with: "Investigating - Cloudflare engineering is investigating an issue causing Access authentication to fail.". So this would somehow validate the theory of auth/quotas started failing right after Google, but what happened after ?! Pure snowballing ? That sounds a bit crazy.

From the Cloudflare incident:

> Cloudflare’s critical Workers KV service went offline due to an outage of a 3rd party service that is a key dependency. As a result, certain Cloudflare products that rely on KV service to store and disseminate information are unavailable [...]

Surprising, but not entirely unplausible for a GCP outage to spread to CF.

Re: GCP Outage

#373

Post by mrngm »

0xffany wrote: post #184

Does anyone know of a good dashboard to check for such BGP routing anomalies as (apparently) this one? I am currently digging around https://radar.cloudflare.com/routing but it doesn't show which routes were actually leaked. I would love if anyone has any good tool recommendations!

My default go-to: https://bgp.tools/

Why would you think this outage is (internet) BGP related?

Re: GCP Outage

#374

Post by ashu1461 »

rco8786 wrote: post #350
ashu1461 wrote: post #81

Earlier quoted context omitted.

Just proves how shady the status page and sla stuff is

Google is 10 minutes late updating their status page. "So shady" It's really, really hard to make a status page realtime.

What makes you think it’s hard? We have AI generating songs and writing code, but setting up basic health checks is too much?

Re: GCP Outage

#375

Post by robin-a »

atonse wrote: post #26

Getting a lot of errors for Claude Sonnet 4 (Cursor) and Gemini Pro. Nooooo I'm going to have to use my brain again and write 100% of my code like a caveman from December 2024.

Cursor throwing some errors for me in Auto Agent mode too.

Re: GCP Outage

#376

Post by paxys »

AdamJacobMuller wrote: post #372
paxys wrote: post #367

Earlier quoted context omitted.

Who said it's a Google outage?

Google. https://status.cloud.google.com/regional/americas

It's more likely to be a broader issue that is affecting AWS, Microsoft, Cloudflare, GCP. They aren't all dependent on Google infra.

Re: GCP Outage

#377

Post by smoe »

whatevertrevor wrote: post #233
rvnx wrote: post #187

Earlier quoted context omitted.

Absolutely possible. Though there is something curious: https://www.cloudflarestatus.com/ At Cloudflare it started with: "Investigating - Cloudflare engineering is investigating an issue causing Access authentication to fail.". So this would somehow validate the theory of auth/quotas started failing right after Google, but what happened after ?! Pure snowballing ? That sounds a bit crazy.

Doesn't cloudflare have its own infrastructure, it's wild to me that both these things are down presumably together with this size of a blast radius.

Latest Cloudflare status update basically confirms that there is a dependency to GCP in their systems:

"Cloudflare’s critical Workers KV service went offline due to an outage of a 3rd party service that is a key dependency. As a result, certain Cloudflare products that rely on KV service to store and disseminate information are unavailable"

Re: GCP Outage

#379

Post by atonse »

cryptonector wrote: post #353
atonse wrote: post #26

Getting a lot of errors for Claude Sonnet 4 (Cursor) and Gemini Pro. Nooooo I'm going to have to use my brain again and write 100% of my code like a caveman from December 2024.

Devs before June 12, 2025: "Ai? Pfft, hallucination central. They'll never replace me!" Devs during June 12, 2025 GCP outage: "What, no AI?! Do you think I'm a slave?!"

100% agree... I even thought "ok maybe I'll clean up the backlog while I wait" but I'm so used to even using AI to clean up my JIRA backlog (using the Atlassian MCP), so even that feels weird to click into each ticket, just the way I used to do it TWO MONTHS AGO.

This is a good wake-up call on how easily (and quickly) we can all become pretty dependent on these tools.

Post reply on HN