GitHub is degraded/down • Hacker News Board

Re: GitHub is degraded/down

#41

Post by caleb-allen » Tue, Apr 21, 2020, 4:09 PM UTC

imedadel wrote: post #37

caleb-allen wrote: post #13

Earlier quoted context omitted.

Reddit and Rocket League servers were degraded simultaneously yesterday, and if I recall correctly they both host on Google Cloud (I may be mistaken there). My paranoia of a high impact state-sponsored cyber attack have been high!

Yup. Google Cloud seems to be having frequent problems lately. However, I feel like GitHub being down AND Stack Overflow would slow down work. And HN is a good place to know what's going on.

Oh for sure. Reddit and Rocket League being down just mangled my relaxation time, GH and SO would have much worse material consequences.

Re: GitHub is degraded/down

#42

Post by lelf » Tue, Apr 21, 2020, 4:10 PM UTC

hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

Not just you.

This page https://web.archive.org/web/20190801000000*/https://github.c... has been[1] “500 internal server error” since late-December (globally it seems). Nobody cares (“not a priority” (c) support), nothing on githubstatus.

[1] blue circles on web.archive are errors too

Re: GitHub is degraded/down

#43

Post by EvanAnderson » Tue, Apr 21, 2020, 4:10 PM UTC

throwanem wrote: post #40

EvanAnderson wrote: post #31

I feel compelled to repeat my earlier sarcasm: If only there was some kind of distributed version control system. /s I don't feel bad being an "old fogie" who demands local copies of my dependencies.

Github is as much or more a collaboration tool as a Git upstream. The Git part is easy to distribute. The collaboration tool, not so much. And to anticipate the likely next argument - no, mailing lists are not a better tool for collaboration. They are distributed, sure. In so saying, I have exhausted the list of their virtues.

The "we deploy production directly from Github" pathology is the one I'm talking about. Not being able to "collaborate" for a brief outage is fine. Not being able to deploy code isn't.

Re: GitHub is degraded/down

#44

Post by bwhitty » Tue, Apr 21, 2020, 4:10 PM UTC

CenturyLink ISP is having issues: https://downdetector.com/status/centurylink/

Re: GitHub is degraded/down

#45

Post by [deleted] » Tue, Apr 21, 2020, 4:11 PM UTC

[deleted]

Re: GitHub is degraded/down

#46

Post by snazz » Tue, Apr 21, 2020, 4:12 PM UTC

coldpie wrote: post #32

snazz wrote: post #21

Earlier quoted context omitted.

No, I don't think so (and I'm also in Minnesota). I'm going to guess that the increased load is just pushing services over the edge. Edit: Also, interestingly enough, I am now reliably hitting Cloudflare's ORD (Chicago) datacenter instead of MSP. If you visit https://snazz.xyz/cdn-cgi/trace (or any other Cloudflare-backed website), what comes after the COLO= for you?

STL! Ha. Wonder what's going on. I'm on CenturyLink here in the Twin Cities.

Yeah, that is strange. I’m on Comcast. They’re probably just attempting to reroute traffic to higher-capacity links at the expense of latency.

Re: GitHub is degraded/down

#47

Post by amirathi » Tue, Apr 21, 2020, 4:12 PM UTC

GitHub is having major availability issues these past three months. 4 incidents in Feb, 4 in March and 6 in April so far.

Source: https://www.githubstatus.com/history

I look forward to reading root cause analysis promised by Nat in Feb: https://twitter.com/natfriedman/status/1233079491204804608

Re: GitHub is degraded/down

#48

Post by ddevault » Tue, Apr 21, 2020, 4:13 PM UTC

hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here:

https://man.sr.ht/ops/

It's also the highest performance software forge by objective measures:

https://forgeperf.org/

Full disclosure: I am the founder of SourceHut.

Re: GitHub is degraded/down

#49

Post by jacobra2 » Tue, Apr 21, 2020, 4:13 PM UTC

At my organization, we saw an uptick in timeouts spanning vendors that started at the same time - 6:55am PST. Makes me think there's an internet wide event occurring right now

Re: GitHub is degraded/down

#50

Post by johns » Tue, Apr 21, 2020, 4:14 PM UTC

coldpie wrote: post #17

MiroF wrote: post #10

Azure is also refusing to allocate me capacity - I'm wondering if this is a general MSFT outage?

Here in Minnesota, several coworkers and I are having trouble with our ISP. And a website we host is (apparently) being DDoSed. And now GitHub's down, and you're reporting some Azure issue. Is something going on...?

Also having issues with CenturyLink fiber at home in MN. Stuff is very slow today.