Live data from Hacker News

Gmail and Google Drive Outage

google.com

21–30 of 88 posts

Re: Gmail and Google Drive Outage

#21

That would explain why my ETLs are failing at 3am in the morning !!!

Your ETL processes write to google drive or are dependent on email? Earnest question, don't mean to sound derisive.

My understanding is part of google cloud failed(Google Cloud Storage), causing many outages, including but not limited to google drive/email.

Re: Gmail and Google Drive Outage

#23
post #22

I'm guessing this outage will allow GSuite customers to claim Service Credits under the SLA - does anyone have any experience with doing so? Google's documentation is lacking in detail[0]. [0] https://gsuite.google.com/intl/en/terms/sla.html

[deleted]

Re: Gmail and Google Drive Outage

#24
The status from Google Cloud status page offers a bit more technical details of what happened:

"We are experiencing an issue with Google Kubernetes Engine (GKE) clusters using node auto-provisioning becoming stuck during node version upgrades. Node auto-upgrades have been disabled temporarily."

https://status.cloud.google.com/

Re: Gmail and Google Drive Outage

#25

That would explain why my ETLs are failing at 3am in the morning !!!

Your ETL processes write to google drive or are dependent on email? Earnest question, don't mean to sound derisive.

User emails file to drive

script connects to drive and parses list of files within

script copies files into redshift and moves original file to different directory or deletes it

alas what can be done? this is what the company gets for building like this ^.^

Re: Gmail and Google Drive Outage

#27
post #19

Incident says it's affecting anything that uses Cloud Storage, which I'm guessing is most things. https://status.cloud.google.com/incident/zall/20007 Edit: New incident number https://status.cloud.google.com/incident/zall/20008

Well this happens if you rely only on 3rd party providers. My email server is still running without any issues and without any indecent for last 3 years (system reinstall).

Surely no one can send me emails now that gmail is down as most of world is relying on single point of failure, but this is another story.

Moral of this story is - always own your mission critical infrastructure.

Re: Gmail and Google Drive Outage

#30
There was an outage August 19th, 2019 - almost 1 year ago to the day. As I posted at the time: "Google often has a outage or two around this time of the year when all the US schools come back and millions of students log in at the same time."

My pet theory wasn't too popular but I'm going to stick with it :)

1- https://news.ycombinator.com/item?id=20740997

Post reply on HN