Live data from Hacker News

GitHub: October 21 Incident Report

blog.github.com

21–30 of 119 posts

Re: GitHub: October 21 Incident Report

#21

Earlier quoted context omitted.

Which is kind of ridiculous. If your CI breaks because GitHub is down, it means it's not caching dependencies locally, but keeps re-downloading them every time it runs (e.g. every commit), generating tons of waste and unnecessary load on the hosting service. Or, to put it bluntly, if your CI works like this, it's contributing to climate change.

That’s an excellent point. How can you tell if the CI system uses caching, other than waiting for a github outage to notice something broke?

Many CI systems provide a build log, do they not? Look for a “git fetch” in it instead of a “git clone”.

Re: GitHub: October 21 Incident Report

#25

Yeah, we're still facing issues with, erm, Github issues. Also, while they haven't updated this blog post for a while, their status page has been very up-to-date and informative: https://status.github.com/messages

> very up-to-date and informative

Is that satire? It said 2-hour ETA 5 hours ago and the last update was over two hours ago.

Re: GitHub: October 21 Incident Report

#26

Yeah, we're still facing issues with, erm, Github issues. Also, while they haven't updated this blog post for a while, their status page has been very up-to-date and informative: https://status.github.com/messages

Yeah but their recovery estimates were completely off. Pulls, hooks, checks and issues still are unusable

Re: GitHub: October 21 Incident Report

#27

Yeah, we're still facing issues with, erm, Github issues. Also, while they haven't updated this blog post for a while, their status page has been very up-to-date and informative: https://status.github.com/messages

> very up-to-date and informative Is that satire? It said 2-hour ETA 5 hours ago and the last update was over two hours ago.

I see an update 7 minutes ago.

>12:56 British Summer Time

>The majority of restore processes have completed. We anticipate all data stores will be fully consistent within the next hour.

Re: GitHub: October 21 Incident Report

#28
post #27

Earlier quoted context omitted.

> very up-to-date and informative Is that satire? It said 2-hour ETA 5 hours ago and the last update was over two hours ago.

I see an update 7 minutes ago. >12:56 British Summer Time >The majority of restore processes have completed. We anticipate all data stores will be fully consistent within the next hour.

Every hour they promise something will be done until the next hour. I haven’t been able to work all day so far.

Re: GitHub: October 21 Incident Report

#29
post #26

Yeah, we're still facing issues with, erm, Github issues. Also, while they haven't updated this blog post for a while, their status page has been very up-to-date and informative: https://status.github.com/messages

Yeah but their recovery estimates were completely off. Pulls, hooks, checks and issues still are unusable

Releasss and gh pages are still completely broken too.

Re: GitHub: October 21 Incident Report

#30
post #10
post #6

I don't understand why code hosting platforms like GitHub, GitLab or BitBucket have so many issues regularly. Is there anything special about it?

Define regularly. I can recall only 2 incidents this year. I think that's not too bad considering the level of traffic they have to contend with.

> Define regularly

More often than what is considered a standard 99.99% uptime SLA? (about an hour per year.)

You seem to be making it out like a couple of days a year of lost [1] developer productivity is no big deal.

That said, these things happen and you should probably check your workflows if you're all that blocked by GitHub being down.

Post reply on HN