Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub is degraded/down

githubstatus.com

Post reply on HN
Print view View original

61–70 of 171 posts

Re: GitHub is degraded/down

#61

Post by onion2k »

hellepardo wrote: post #5
thsowers wrote: post #3

Earlier quoted context omitted.

If you view the historical uptime, it does seem like there have been more incidents in the past three months, but otherwise the waters look calm (as reported at least): https://www.githubstatus.com/uptime?page=1

Yes, and so this is actually a thing that bugs me, because I use Github every day. Over the past several months, there have been numerous days in which I've had problems (`You can not comment at this time`, 500s, etc.) and no corresponding status report. It seems like the historical uptime page paints a far rosier picture than I am actually experiencing.

It's almost as if keeping a complex service like Github online and available to millions of users is hard.

Re: GitHub is degraded/down

#62

Post by cranekam »

leetrout wrote: post #36
xkcd-sucks wrote: post #29

Earlier quoted context omitted.

In an ideal world, pushing new features would have no impact on stable mature features like browsing files, comment threads, etc

That’s part of the micro service promised land, right?

No, I think it's more part of how to run a complex system with a lot of people changing stuff at once. Having good monitoring, kill switches, staged rollout, continuous deployment, and so on are all things that contribute more making a reliable service than how microserviced it is.

Re: GitHub is degraded/down

#64

Post by dijit »

bob1029 wrote: post #57

Today marks the 3rd time I've broached the topic w/ management of getting the self-host enterprise option... Compared to (public) GitHub's problems this year so far, our AWS EC2 instances are orders of magnitude more reliable. Sure, the internet can still go down, but my VPN into us-east-1 from Texas has been unbroken for weeks now. At this point I'd almost prefer to pull it all in-house and manage it myself so the e…

I'm not sure the irony is lost on you that; people generally prefer services like github (and; similarly EC2) precisely _because_ it's not on-prem and that if it's down there are hundreds of talented engineers working to resolve those issues.

Unfortunately anecdotal experience here is spotty. Services I run for my team are several 9's higher in terms of actual availability (note: I did not say "uptime"); and contrarily other internal services at my company have many times less reliability than services like github.

Given that people prefer external hosting for the reasons I mentioned, for many I think pulling it in-house is unappealing.

Re: GitHub is degraded/down

#65

Post by jansan »

csomar wrote: post #34
hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

My guess is opening their paying offering for free and also Github actions which is CPU-intensive and does much more than the traditional CI/CD tools.

I prefer to pay 8$ per month for a stable service any time over 4$ per month over a service that fails during a critical build, just like it happened to me this time.

Re: GitHub is degraded/down

#66

Post by super3 »

Gehinnn wrote: post #63
super3 wrote: post #60

Earlier quoted context omitted.

Should only be 2-3 PB. Storing it all on https://tardigrade.io

The site says "Storing 542 TB" though :D

Have been increasing sync speed over time. It about double where it was a few weeks ago. It definitely does take some time to upload so much data.

Re: GitHub is degraded/down

#67

Post by bdcravens »

ddevault wrote: post #48
hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

I'm sure you've done a great job building up your infrastructure, but if you have the level of traffic Github has, what would your uptime be?

Re: GitHub is degraded/down

#69

Post by sky_rw »

ddevault wrote: post #48
hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

It's unfair to Github to make the claim that your infra is more resilient and better maintained. Their load is orders of magnitude greater than yours. My driveway also doesn't have potholes it doesn't mean it's more resilient than the freeway.

Re: GitHub is degraded/down

#70

Post by japhyr »

mbreese wrote: post #33
beamatronic wrote: post #19

Earlier quoted context omitted.

I had never heard of Microsoft Teams until yesterday when I saw it on a TV commercial.

For companies that live on Office 365, it is very popular. With COVID-19, it became a very quick add-on for groups that were already in the O365 ecosystem to add group chat functionality, pretty much with a few clicks. My son’s school was using it before they went remote, but now their usage has increased dramatically.

I wonder how much the load will change once schools close for the summer. All of these attempts at remote teaching and learning will stop over a period of several weeks, and I imagine a large amount of capacity will be available again for a while?
Post reply on HN