Live data from Hacker News

GitHub is degraded/down

githubstatus.com

81–90 of 171 posts

Re: GitHub is degraded/down

#81
post #7

I think my biggest nightmare is SO, GH, and HN all being down at the same time. Edit: A nightmare is an exaggeration. But it would slow down work.

Reddit and Rocket League servers were degraded simultaneously yesterday, and if I recall correctly they both host on Google Cloud (I may be mistaken there). My paranoia of a high impact state-sponsored cyber attack have been high!

I think AWS was having issues yesterday and today as well. Do you think someone is targeting cloud providers?

Re: GitHub is degraded/down

#82

Earlier quoted context omitted.

Github is as much or more a collaboration tool as a Git upstream. The Git part is easy to distribute. The collaboration tool, not so much. And to anticipate the likely next argument - no, mailing lists are not a better tool for collaboration. They are distributed, sure. In so saying, I have exhausted the list of their virtues.

The "we deploy production directly from Github" pathology is the one I'm talking about. Not being able to "collaborate" for a brief outage is fine. Not being able to deploy code isn't.

Not sure why you're getting downvoted, but yes, there are plenty of businesses that can't afford an outage in the push-to-prod path.

But it might be worth keeping in mind that there are plenty of businesses that can afford afford delays, especially if they can save money in exchange for that higher risk.

As always, engineering isn't about the perfect solution for everybody, but the right tradeoffs for your particular use case.

Re: GitHub is degraded/down

#83

I don't think it's just GitHub. I noticed everything seemed slow but thought it was just my ISP. Turns out from looking at downdetector.com there seems to be a large spike in reported problems across many sites and providers, all occurring at the same time.

Yeah apparently Centurylink and Comcast are having issues as well. Customers have been complaining about slow load times with our products today. Coworkers complaining about slow load times in general and especially with Salesforce. I’m being rerouted from my local CloudFlare data center to Chicago as well.

Not entirely sure what’s up, but this doesn’t thing like an issue limited to only GitHub.

Re: GitHub is degraded/down

#84

Earlier quoted context omitted.

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

your $2/month pricing. Is it $2/person/month?

Yes.

Re: GitHub is degraded/down

#86
post #69

Earlier quoted context omitted.

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

It's unfair to Github to make the claim that your infra is more resilient and better maintained. Their load is orders of magnitude greater than yours. My driveway also doesn't have potholes it doesn't mean it's more resilient than the freeway.

I don't think so. I backed up the claim here:

https://news.ycombinator.com/item?id=22936448

SourceHut is at least 10x lighter weight and has a distributed, fault tolerant design which would allow you to continue being productive even in the event of a total outage of all SourceHut services.

Re: GitHub is degraded/down

#89

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

Thanks for being so transparent about your operations.

Maybe this is somewhere in the manual and I missed it, but do you have some way of automating the configuration of your hosts and VMs? For example, do you use something like Ansible?

Re: GitHub is degraded/down

#90

At my organization, we saw an uptick in timeouts spanning vendors that started at the same time - 6:55am PST. Makes me think there's an internet wide event occurring right now

Which providers are you seeing issues with? I'm curious if we can corroborate.
Post reply on HN