Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub is degraded/down

githubstatus.com

Post reply on HN
Print view View original

111–120 of 171 posts

Re: GitHub is degraded/down

#111

Post by EvanAnderson »

throwanem wrote: post #95
EvanAnderson wrote: post #43

Earlier quoted context omitted.

The "we deploy production directly from Github" pathology is the one I'm talking about. Not being able to "collaborate" for a brief outage is fine. Not being able to deploy code isn't.

As a side note, gotta say, scare-quoting "collaborate" seems like a pretty weird flex in a time when everybody's stuck working from home whether they prefer it that way or not. Maybe you prefer to work entirely within a silo, rarely dealing with colleagues in the course of your day-to-day. Most don't, nor should they. Most kinds of work, even the kinds of work that we do, really aren't better done that way. I worked…

You read a lot more into that that I intended.

I'm suffering some fatigue w/ the word "collaborate" being thrown around in marketing collateral right now. You used the word several times, and I engaged my "marketing avoidance" mode.

Re: GitHub is degraded/down

#112

Post by lovegoblin »

xkcd-sucks wrote: post #29
shriek wrote: post #6

Earlier quoted context omitted.

They've been pushing lots of features in the platform so not surprising that it's a bit unstable now.

In an ideal world, pushing new features would have no impact on stable mature features like browsing files, comment threads, etc

Which world is that?

Re: GitHub is degraded/down

#113

Post by dwwoelfel »

throwanem wrote: post #28

CircleCI's having a lot of trouble, too. Intermittent 500s, and even the images on the 500 page don't load. Seems like something bigger might be going on.

What usually happens with CircleCI after a GitHub outage is that they're hit with a flood of GitHub webhooks when GitHub comes back online. Then Circle starts to slow down under the load of all of the new jobs that have been queued.

One usually causes the other, so we shouldn't infer anything larger from that datapoint.

Re: GitHub is degraded/down

#114

Post by nimbius »

hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

you could move to gitlab, but from what im hearing the pricing is higher than github (is this still true?)

Barring that you always have the tried and true (and for some reason abhorred by start-ups) option of running your own gitea or gitlab instance. Its not hard, and most of this stuff can be done in dockerless containers if you want.

If cloud servers are getting "overloaded" as some commenters say, you could even buy a few racks or u's of colo somewhere or use a cloud provider that isnt the most popular meme on YC. Vultr and ramnode are both good options and youd be supporting a small business, not Bezos next giga-yacht.

Re: GitHub is degraded/down

#115

Post by ddevault »

mwcampbell wrote: post #107
ddevault wrote: post #93

Earlier quoted context omitted.

No, I provision them manually. Being based on Alpine Linux makes this less time-consuming and more deterministic. At some point I might invest in something completely automated, but right now the manual approach is simpler - and if it's not broke, don't fix it.

Ah, OK. Also, have you written anywhere about why you chose to use colocation rather than VPS (or "cloud") hosting, or leased dedicated hosting for the CI system? If you could use someone else's hardware rather than having to select, buy, and set up your own, then at least in theory, you could spend more time on other things. But I'm sure you have your reasons for making the choice that you did. I'm just curious abou…

There are lots of reasons, but the most obvious one is cost. All of SourceHut's servers are purpose-built for a particular role, and their hardware is tuned to that. The server that git.sr.ht runs on is pretty beefy- it cost me $5.5K to build. I paid that once and now the server belongs to us forever. I ran the same specs through the AWS price estimator, and it would have cost ten grand per month.

Re: GitHub is degraded/down

#116

Post by throwanem »

EvanAnderson wrote: post #111
throwanem wrote: post #95

Earlier quoted context omitted.

As a side note, gotta say, scare-quoting "collaborate" seems like a pretty weird flex in a time when everybody's stuck working from home whether they prefer it that way or not. Maybe you prefer to work entirely within a silo, rarely dealing with colleagues in the course of your day-to-day. Most don't, nor should they. Most kinds of work, even the kinds of work that we do, really aren't better done that way. I worked…

You read a lot more into that that I intended. I'm suffering some fatigue w/ the word "collaborate" being thrown around in marketing collateral right now. You used the word several times, and I engaged my "marketing avoidance" mode.

That's fair. My circle includes several acquaintances who prefer talking loudly about how engineering should be, to accomplishing much of anything in the realm. So, similarly overfitting, I engaged a mode of my own.

Re: GitHub is degraded/down

#118

Post by cm523 »

erikpukinskis wrote: post #79
ddevault wrote: post #48

Earlier quoted context omitted.

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

Sidebar, I just want to say, you are one of the few people I’ve observed doing actual “modern” web development. When most people talk about “modern web” or modern anything in software they think it means “using all the latest tools”. That often means things like ES6 and Webpack, which have nice surfaces, but which create nightmares under the hood. That’s the opposite of what modern architecture was. It was about embr…

Care to expand on this some more? Perhaps you have some other examples of both good front-end and server side, modern, day web development?

Re: GitHub is degraded/down

#119

Post by kerng »

hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

As many readers are stating there seem to be larger, internet-wide issues today in US.

Re: GitHub is degraded/down

#120

Post by addHocker »

vikramkr wrote: post #8
hellepardo wrote: post #2

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

It might also be covid related. People are working from home, people responsible for system upkeep might not be immediately responsive, more demand on the servers for whatever reason, etc.

The delay/service unavailablity should follow the work at home schedule then- pushes pre-lunch and pre evening dinner.
Post reply on HN