Live data from Hacker News

Google outage – resolved

news.ycombinator.com

511–520 of 870 posts

Re: Google outage – resolved

#511

Yeah weird it’s all green. I just noticed things down as well. Came to HN to see how quickly people posted. This is already #1 at 6:55 am EST

Yeah, that status page is really frustrating. Didn't anyone consider building it to REALLY check if services were working? not just returning a 200 Status... but actually DOING things?

Re: Google outage – resolved

#515

Earlier quoted context omitted.

What exactly did you do that makes you so confident?

Exactly after my setIamPolicy API request to Google Cloud was the exact moment everything went down.

I'd wager a guess that you set up some weird 'expression'? coupled with some bug in the IAM service, maybe some stale resources that you were deleting at the same time?

I'd then assume once expression is evaluated the services end up busy looping / proxies throwing out internal errors and taking out capacity.

Still, you shouldn't be able to cause downtime to more then a few servers in the extremely unlikely case I am anywhere close.

PS: - I haven't used googles IAM so guessing after a few min of reading docs.

- you are incredibly unlikely to have triggered this at google's scale.

Re: Google outage – resolved

#516
post #188

Earlier quoted context omitted.

HN is my goto status page when these things happen, never failed to provide up-to-date reliable information.

Seems like everyone going on HN now. The site is so slow

HN was having problem showing anything for the past 10 min or so. I was going to ask if HN was down, then I saw this.

Re: Google outage – resolved

#517

edit: added details edit: redacted my phone number edit: big mistake to add phone number edit: I think illic is right, probably not me edit: removed details

If it was you, why the hell on earth would you bother exposing your personal phone number on the internet and asking google to call you on this post? Like, seriously...

Wouldn't you rather call them directly on the hotline...?

That's a phone number from Bulgaria, and it looks like it should be part of the Vivacom GSM network, so I guess it's his personal mobile phone number or a scam.

Re: Google outage – resolved

#518
post #381

edit: added details edit: redacted my phone number edit: big mistake to add phone number edit: I think illic is right, probably not me edit: removed details

It’s probably not you.

Although since it seems to be back up now I suppose there is one way we could find out for sure.

Re: Google outage – resolved

#519
post #292

Given the blast radius of this (all regions appear to be impacted) along with the fact that services that don't rely on auth are working as normal, it must be a global authN/Z issue. I do not envy Google engineers right now.

Nope, especially considering the implications of this, with the amount of people working remotely. Google Meet, Classroom, etc. are down. This is probably literally costing billions every minute just in loss of productivity.

Total world economic output is ~$150M / minute, so billions every minute is off by few orders of magnitude.
Post reply on HN