Live data from Hacker News

Google App Engine is experiencing service outages

status.cloud.google.com

11–17 of 17 posts

Re: Google App Engine is experiencing service outages

#12
post #3

I'm curious how widespread it is. My app engine app is working fine, and I don't see any errors in the logs.

We're affected. All Cloud Storage reads/writes are down for 14 hours now :( Edit: It's back up now.

14 hours?! Are you able to do anything within what they provide? Can you access your data in some way to move it elsewhere or something like that?

But wow... I thought 15 minutes would be a huge downtime for a service provided by Google.

Re: Google App Engine is experiencing service outages

#13
post #12

Earlier quoted context omitted.

We're affected. All Cloud Storage reads/writes are down for 14 hours now :( Edit: It's back up now.

14 hours?! Are you able to do anything within what they provide? Can you access your data in some way to move it elsewhere or something like that? But wow... I thought 15 minutes would be a huge downtime for a service provided by Google.

Yes, this is the longest downtime I've had on App Engine for years. I've been up all night and the app engine team were up working on it as well and sending updates.

It seems that the default authentication method broke for some apps. They have different APIs to reach your data, and I tried another approach and it worked, but it's different enough, and we use Cloud Storage in too many places, that it would take a day or more to change our code to use it. I started on it anyway, in case the outage lasts longer.

Re: Google App Engine is experiencing service outages

#14
post #12

Earlier quoted context omitted.

14 hours?! Are you able to do anything within what they provide? Can you access your data in some way to move it elsewhere or something like that? But wow... I thought 15 minutes would be a huge downtime for a service provided by Google.

Yes, this is the longest downtime I've had on App Engine for years. I've been up all night and the app engine team were up working on it as well and sending updates. It seems that the default authentication method broke for some apps. They have different APIs to reach your data, and I tried another approach and it worked, but it's different enough, and we use Cloud Storage in too many places, that it would take a day…

We're also affected, our app runs in EU datacenters. We had auth errors on both Cloud Storage and BigQuery. BigQuery seems to work now, but not Cloud Storage. Our last outage was 2013, but this has been going on for over 12 hours..
Post reply on HN