Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Public CA is down

status.pki.goog

Post reply on HN
Print view View original

121–130 of 166 posts

Re: Google Public CA is down

#121

Post by bigbuppo »

ocdtrekkie wrote: post #95
Arainach wrote: post #92

Earlier quoted context omitted.

.....no? "We deployed this private cloud with a missing parameter and it wasn't caught" is as different from "we wiped out all customer data" as hello world is from Kubernetes. No one promised this "should be impossible". Did you confuse "we'll take steps to ensure this never happens again"?

It's pretty much half the puzzle actually. You contend there's no global rm rf for a global cloud provider, but clearly a missing parameter can rm rf a customer in an irrecoverable manner. The only half you're missing is... how every major cloud outage happens today... a bad configuration update. These companies have hundreds of thousands of servers, but they also use orchestration tools to distribute sets of changes…

And the most telling thing about most of these outages is that the provider later admits in their postmortem that they just didn't really understand how the system they made worked until it fell over and were forced to learn how it really works.

It's the sort of thing that used to keep me up at night.

Re: Google Public CA is down

#122

Post by codys »

kyledrake wrote: post #112

People went ballistic on me a few months ago for bringing this up, but this is exactly the kind of outage that makes me really, really worried about extremely short lived certificates. https://news.ycombinator.com/item?id=46118371

I'm not sure I follow. This outage seems like it occurred for less than 1 day. The post you link to is about having certificates expire after 45 days. What's the connection you see?

Re: Google Public CA is down

#124

Post by _qib3 »

bigbuppo wrote: post #29
tokyobreakfast wrote: post #22

It's a good thing we have ever-shrinking certificate lifetimes and automation never breaks. That's what I've been told, anyway.

Yeah, this could end up as the actual root cause of The Great Oops that I've been raving about for years. And Google probably would be the right company to fuck it up in the worst way possible since Google Knows Best In All Situations.

Do you have a blog post on the oops? I'd love to read it.

Re: Google Public CA is down

#125

Post by TwoNineFive »

kyledrake wrote: post #112

People went ballistic on me a few months ago for bringing this up, but this is exactly the kind of outage that makes me really, really worried about extremely short lived certificates. https://news.ycombinator.com/item?id=46118371

Your license to website has been revoked.

Re: Google Public CA is down

#126

Post by TwoNineFive »

codys wrote: post #122
kyledrake wrote: post #112

People went ballistic on me a few months ago for bringing this up, but this is exactly the kind of outage that makes me really, really worried about extremely short lived certificates. https://news.ycombinator.com/item?id=46118371

I'm not sure I follow. This outage seems like it occurred for less than 1 day. The post you link to is about having certificates expire after 45 days. What's the connection you see?

You didn't read it or understand it.

Re: Google Public CA is down

#127

Post by Arainach »

bigbuppo wrote: post #116
Arainach wrote: post #106

Earlier quoted context omitted.

The release process, monitoring checks, etc. for a customer's private cloud is generally significantly different from the release process for a global product. I'm not going to get any more specific for all the standard NDA reasons, but having worked for Google and Microsoft among others....no, the risk you describe doesn't translate from one to the other.

Do you not remember crowdstrike?

Again: an outage caused by a config change is different from data loss.

The remediation was painful but it was not data loss.

Re: Google Public CA is down

#128

Post by VorpalWay »

0_____0 wrote: post #111
PostOnce wrote: post #81

Earlier quoted context omitted.

They've begun injecting obnoxious ads into the downloadable mp3s on a lot of podcasts I've found. Hyperlocal ads for tire shops and bakeries. I don't want to buy tires, I want to learn about ______. The ads don't even make sense because they're irrelevant.

VPN to Sweden to get the IP geolocated ads to retarget. The ads still exist but they're less obnoxious, and they're often in Swedish so you don't have to know what they're on about anyway.

And what are we Swedes supposed to do?

Re: Google Public CA is down

#129

Post by 2Gkashmiri »

TMEHpodcast wrote: post #43

It is a well-known fact that the moment YouTube goes down, the collective productivity of Earth increases by approximately 4,000%, which is immediately squandered by everyone going to Hacker News to read comments about YouTube being down. I myself have taken to podcasts… an ancient medium in which people simply talk at you for ninety minutes without a single sponsorship for a mobile game, and this is considered a fai…

I watched a movie, same late night talk show host, something like "welcome night owls".

I "loved" the style but I haven't found any actual radio on the internet of that style or a podcast. Not sure about name of movie but I do remember it being in the last 10-15 years.

Re: Google Public CA is down

#130

Post by enlightens »

VorpalWay wrote: post #128
0_____0 wrote: post #111

Earlier quoted context omitted.

VPN to Sweden to get the IP geolocated ads to retarget. The ads still exist but they're less obnoxious, and they're often in Swedish so you don't have to know what they're on about anyway.

And what are we Swedes supposed to do?

VPN to Greece!

https://en.wikipedia.org/wiki/Greek_to_me#:~:text=Swedish

Post reply on HN