It's restored now.
Google outage – resolved
531–540 of 870 posts
Re: Google outage – resolved
#532Earlier quoted context omitted.
Nope, especially considering the implications of this, with the amount of people working remotely. Google Meet, Classroom, etc. are down. This is probably literally costing billions every minute just in loss of productivity.
Total world economic output is ~$150M / minute, so billions every minute is off by few orders of magnitude.
That figure seems way too low, what are your sources on it?
Re: Google outage – resolved
#533So, anybody still feel like arguing that 'the cloud' is a viable back-up? Or is that a sore point right now? Just for a moment imagine: what if it never comes back again? Of course it will, - at least, it better - but what if it doesn't? And if it does, are you going to take countermeasures in case it happens again or is it just going to be 'back to normal' again?
What worries me the most is email. I basically don't use any other Google services other than Gmail and YouTube, but for email I really don't know of an alternative. Sure you can argue "move to Fastmail/Protonmail/Hey/whatever", but those can also go down on you just like Google is down now. And self hosting email is apparently not a thing due to complexity and having to forever fight with being marked as spam (ndr.:…
I've been using mailu.io to host my own email server. Makes it real easy to manage yourself.
I haven't had any issues with new domains being marked as spam, but I always make sure the SPF, DKIM and DMARC records are set up.
Re: Google outage – resolved
#534"all green, which does not reflect reality for me (e.g. Gmail is down)"
This isn't true. Which make it more complicated as we try to figure out what systems are down -- since their status board is usually faked.
gcloud compute instance-groups list-instances [removed] --zone=us-central1-c | awk '{print $1}' | grep -v NAMEERROR: (gcloud.compute.instance-groups.list-instances) Some requests did not succeed: - Internal Error
Re: Google outage – resolved
#5354:41AM PT, Google services have been restored to my accounts (free & gsuite).
And I have never seen them load so fast before - gmail progress bar barely seen for a fraction of a second whereas I am more used to seeing it for multiple seconds (2-3 sec) until it loads.
I observe the same anecdotal speedup for other sites... drive, youtube, calendar. I wonder if they are throwing all the hardware they have at their services or I am encountering underutilized servers since it is not fixed for everyone.
It is nice to experience (even if it is short lived) the snappiness of Google services if they weren't so multi-tenented.
Re: Google outage – resolved
#536First the two Gmail accounts I had in Thunderbird logged me out and asked to relogin.
Then Google said my accounts did NOT exist which made me feel very uneasy. Banned? Lost all my data? OMG.
Then I got error "502 That's all we know" after entering my passwords.
Finally I realized it couldn't be just me, so I opened HN and confirmed my suspicions.
It's all up and running now but I was really scared.
I'm really curious what happened because it surely looks like Google has a single point of failure in their authentication mechanism which is just horribly wrong. The company has over two billion users - a situation/configuration like this just shouldn't be even theoretically possible.
Re: Google outage – resolved
#537The Google outage is one of the top BBC headlines now, so it has become mainstream news: https://www.bbc.co.uk/news/technology-55299779 "The outage started shortly before noon UK time, with Google sites returning server errors when visited. Users around the world reported problems with Gmail, Google Drive, the Android Play Store, Maps, and more. ... Despite the widespread outage, Google's service dashboard for its se…
"Google has been contacted for comment, but one spokesperson said they were unable to access their email."
Re: Google outage – resolved
#538So, anybody still feel like arguing that 'the cloud' is a viable back-up? Or is that a sore point right now? Just for a moment imagine: what if it never comes back again? Of course it will, - at least, it better - but what if it doesn't? And if it does, are you going to take countermeasures in case it happens again or is it just going to be 'back to normal' again?
Most of the things I backed up for myself are either gone forever or irretrievably lost.
Most of the things I backed up with google remain largely accessible, except for an occasion like this.
It's rare that any services I operate solo come back this quickly after there is a downing issue.
Re: Google outage – resolved
#539[deleted]
Re: Google outage – resolved
#540edit: added details edit: redacted my phone number edit: big mistake to add phone number edit: I think illic is right, probably not me edit: removed details
Or the more realistic scenario is that the outage happened before you did getIamPolicy which is what caused the garbage data.