Earlier quoted context omitted.
Helps Google meet a 99.999% SLA!
Not really since now it's up, and the status page still says it's down.
right after I shamed them on twitter. I take responsibility despite it unlikely having any impact.
Google outage – resolved
621–630 of 870 posts
Re: Google outage – resolved
#622When I tried to login it said: 'this account does not exist'. So my first thought was some algorithm made a mistake and my account got deleted for no reason.
I already imagined the only solution now was to write a medium post and hope it gets some traction on hackernews and google support steps in. Thinking to myself I was an idiot for knowing all this and still thinking it wouldn't happen to me.
And even though it turns out to be an outage, it gave me a bad enough feeling to start using a domain name I own for my email.
Re: Google outage – resolved
#623Re: Google outage – resolved
#624Has google.com ever suffered such outages in recent past?
Re: Google outage – resolved
#625Just checked https://www.google.com/appsstatus all green, which does not reflect reality for me (e.g. Gmail is down) edit: shows how incredibly difficult introspection is
It reflects the reality for them.
The small print says: The problem with Gmail should be resolved for the vast majority of affected users. We will continue to work towards restoring service for the remaining affected users...
At Google scale, "remaining affected users" probably number in tens of millions. Sucks to be one of them, tho.
But hey, it happens. As a SaaS maintainer, I can sympathise with any SREs involved in handling this, and know that no service can be up 100% of the time.
Re: Google outage – resolved
#626At times like this I am thankful of running a Google takeout periodically. Not because I use it as a live failover for Google services, but because these outages are good reminders of the mortality of online services.
How long did your takeout take? It’s been 3 weeks and mine either says not ready yet, or when it is it will say unable to download and force me to start again...
When I request a full takeout it usually takes 2-4 weeks to generate.
This time around it was missing a .tgz which had error'd. A subsequent full takeout request took a couple of days.
The .tgz files I find can only be reliably extracted on a Linux... the Gmail export for me is 20GB which in the last few exports has been a single file in the last .tgz
Re: Google outage – resolved
#627Earlier quoted context omitted.
World GDP was ~$90B last year ( https://databank.worldbank.org/data/download/GDP.pdf ), which averages to ~$150M/minute
That's trillion not billion
https://en.wikipedia.org/wiki/Billion
A billion is a number with two distinct definitions:
- 1,000,000,000, i.e. one thousand million, or 10^9, as defined on the short scale. This is now the meaning in both British and American English.
- 1,000,000,000,000, i.e. one million million, or 10^12, as defined on the long scale. This is one thousand times larger than the short scale billion, and equivalent to the short scale trillion. This is the historical meaning in English and the current use in many non-English-speaking countries where billion and trillion 10^18 maintain their long scale definitions.
Nevertheless almost everyone uses 1B = 10^9 for technical discussions
Re: Google outage – resolved
#628Services are not restored. Some came up again, some not. My Gsuite business mail is still completely down, while youtube started working again. I'm pretty sure there will be some internal conferences at Google after this to make sure infrastructure problems can't propagate across the entire company and world at this rate even in the event of a sysop fatfingering a console...
If you are still down try restarting app... this worked for me
Re: Google outage – resolved
#629Just got a text from my kids' school saying GMail is down and to use the school's direct email. Immediate reaction was "Google isn't down you idiots, the problem is on your end", go to check GMail, yep it's down.
yeah this is like saying it must be a compiler bug
I had a few of these this year, e.g. thinking I have local connectivity issues when it turned out the entire backbone is in a bad shape[0].
Or that time when 80% of the apps on my iPhone crashed on launch[1] — must be an issue with the device, right?
[0] Level 3 Global Outage - https://news.ycombinator.com/item?id=24322861
[1] Facebook iOS SDK Remotely Crashing Spotify, TikTok, Pinterest, Winno and More - https://news.ycombinator.com/item?id=23097459
Re: Google outage – resolved
#630Given the blast radius of this (all regions appear to be impacted) along with the fact that services that don't rely on auth are working as normal, it must be a global authN/Z issue. I do not envy Google engineers right now.
Nope, especially considering the implications of this, with the amount of people working remotely. Google Meet, Classroom, etc. are down. This is probably literally costing billions every minute just in loss of productivity.
I was unable to watch the Mogwai - Autorock music video. :-(