Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google outage – resolved

news.ycombinator.com

Post reply on HN
Print view View original

611–620 of 870 posts

Re: Google outage – resolved

#611

Post by jiggawatts »

mozinator wrote: post #322

edit: added details edit: redacted my phone number edit: big mistake to add phone number edit: I think illic is right, probably not me edit: removed details

That reminds me of the time when I plugged a network cable back into an Active Directory domain controller. At the exact same time as the RJ-45 plug would have made the little "click", a door slammed shut and a polished steel tanker truck drove by the window, shining a bright light into my eyes.

I had just plugged into a cable into the most important server in the organisation and I saw a bright flash and hear a bang.

All was well, it was just a coincidence, and a good reminder that sometimes shit happens and it's not us, it's just timing.

Relax.

Re: Google outage – resolved

#613

Post by capableweb »

illic wrote: post #517
mozinator wrote: post #322

edit: added details edit: redacted my phone number edit: big mistake to add phone number edit: I think illic is right, probably not me edit: removed details

If it was you, why the hell on earth would you bother exposing your personal phone number on the internet and asking google to call you on this post? Like, seriously... Wouldn't you rather call them directly on the hotline...? That's a phone number from Bulgaria, and it looks like it should be part of the Vivacom GSM network, so I guess it's his personal mobile phone number or a scam.

> why the hell on earth would you bother exposing your personal phone number on the internet

Why not? It's not like you're gonna receive death threats exactly. I've had my personal phone number on my public website and in the footer of every outgoing email for 15+ years, never had any problems, spam or otherwise.

Re: Google outage – resolved

#616

Post by sn41 »

cvrjk wrote: post #304
have_faith wrote: post #56

Gmail said my account was "temporarily" unavailable... had a moment considering if it wasn't temporary. Good reminder to remove my reliance on gmail especially.

For a second I legit thought Google banned my account for some reason. And I don't like it that I feel relieved..

Underrated comment. If the government freezes your bank account, at least you can take them to court. If Google mistakenly disables your account, there does not seem to be any legal recourse. Considering the extent to which people depend on their services, perhaps there should be a more elaborate appeal process.

Re: Google outage – resolved

#617

Post by throwawaylolx »

Macha wrote: post #369
davnicwil wrote: post #248

Earlier quoted context omitted.

Interesting cascade effect of sites going down! I wonder where people will go next to check if HN is down? Also wondering if this is perhaps the fastest upvoted HN post ever? 8 mins -> ~350 votes, 15 mins -> ~750 votes. I wonder if @dang could chime in with some stats? Update: looks like it hit 1000 upvotes in ~25 mins! Update: 1500 in ~40 mins Update: 2000 in ~1 hour 20 mins (used the HN API for the timestamp)

Some politics topics have shot up pretty quickly in the past but user and/or mod flags send them back to page 2 about as quickly.

Funny this post is already #7. Are we seeing many reports again?

Stats right now: 1985 points | 1 hour ago | 597 comments

Re: Google outage – resolved

#618

Post by robertlagrant »

ignoramous wrote: post #596
tarruda wrote: post #529

Earlier quoted context omitted.

> I do not envy Google engineers right now. A few years ago I released a bug in production that prevented users from logging into our desktop app. It affected about ~1k users before we found out and rolled back the release. I still remember a very cold feeling in my belly, barely could sleep that night. It is difficult to imagine what the people responsible for this are feeling right now.

Same. At AWS, I once took an entire AZ down of a public-facing production service (with a mis-typed command), but that was nothing compared to when I accidentally deleted an entire region via internal console (too many browser tabs). Thank goodness turned out to be unused / unlaunched, non-production stack. I felt horrible for hours despite zero impact (in both the cases).

Who automates the automators? :)

Re: Google outage – resolved

#619

Post by solids »

tarruda wrote: post #529
mmillin wrote: post #121

Given the blast radius of this (all regions appear to be impacted) along with the fact that services that don't rely on auth are working as normal, it must be a global authN/Z issue. I do not envy Google engineers right now.

> I do not envy Google engineers right now. A few years ago I released a bug in production that prevented users from logging into our desktop app. It affected about ~1k users before we found out and rolled back the release. I still remember a very cold feeling in my belly, barely could sleep that night. It is difficult to imagine what the people responsible for this are feeling right now.

Well, it's something that can happen to anyone, take it easy. When I made the transition from developer to manager and become responsible for this situations, at first every problem made me feel as you describe. Eventually what helped me to be free is the understanding that how we feel about a fact does not change anything about that fact.

Re: Google outage – resolved

#620

Post by [deleted] »

rubatuga wrote: post #554
hackernews1134 wrote: post #535

4:41AM PT, Google services have been restored to my accounts (free & gsuite). And I have never seen them load so fast before - gmail progress bar barely seen for a fraction of a second whereas I am more used to seeing it for multiple seconds (2-3 sec) until it loads. I observe the same anecdotal speedup for other sites... drive, youtube, calendar. I wonder if they are throwing all the hardware they have at their serv…

Oh man, you're right. Bloated gmail loaded instantly. What's going on? It's loading almost 2x to 3x faster.

[deleted]
Post reply on HN