Live data from Hacker News

GitHub is degraded/down

githubstatus.com

141–150 of 171 posts

Re: GitHub is degraded/down

#141
post #51

Created https://gitbackup.org for this very reason.

Out of curiosity how do you or how to you plan to monetize this? Seems like it would get expensive really quickly.

It is a tech demo of https://tardigrade.io, because easily storing all of Github certainly gets peoples attention.

Its only expensive because cloud providers overcharge. The listed prices on Tardigrade start at half of Amazon S3, and there are significant discounts if you are storing more than 100 TB.

Re: GitHub is degraded/down

#142

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

you could move to gitlab, but from what im hearing the pricing is higher than github (is this still true?) Barring that you always have the tried and true (and for some reason abhorred by start-ups) option of running your own gitea or gitlab instance. Its not hard, and most of this stuff can be done in dockerless containers if you want. If cloud servers are getting "overloaded" as some commenters say, you could even…

>Vultr and ramnode are both good options and youd be supporting a small business, not Bezos next giga-yacht.

vultr is considered a small business now? crunchbase lists them as having 50-100 employees, and they seem to be owned by Choopa, LLC which some sources list as having 150 employees.

Re: GitHub is degraded/down

#143
post #16
post #8

Earlier quoted context omitted.

It might also be covid related. People are working from home, people responsible for system upkeep might not be immediately responsive, more demand on the servers for whatever reason, etc.

Maybe it's the demand side? With remote work, the intensity of usage went up at least in our company as we rely more on written communication. At the same time, some people will use the time to start side projects or get into programming.

On the other hand, shouldn't there be a productivity drop with so many people working from home while their kids also aren't in school? I'd expect that to offset any increase in demand—after all, Git isn't Slack; remote work shouldn't cause people to push all that much more often, right?

Re: GitHub is degraded/down

#144

Is it just me, or has Github's quality of service been continually degrading over the past several months? What is going on internally? Is this because of the Microsoft acquisition? Increased usage? An internal transition to Azure? ...is it time to move away from Github?

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

A little bit off topic. I just wondering it support git write access over https? Not just read only.

Re: GitHub is degraded/down

#145

Earlier quoted context omitted.

> SourceHut over GitHub as a service which can be expected to have better uptime and performance, because it is a fact Most of us could throw any of the open source solutions on a $20 Linode instance and probably have excellent uptime. How many active repos do you host, and on how many servers?

About 18K git & hg repositories, for about 13.5K users. We also run about 5,000 CI jobs per week, including for some large projects like Nim and Zig, Neovim, OpenSMTPD, etc. We have 10 dedicated servers at the moment. And I didn't throw an open source solution on these servers - I built these open source services from the ground up.

So you're comparing your scalability with a company with over 40m users and 100m repos.

Can you talk about the geographic distribution of your 10 servers?

Re: GitHub is degraded/down

#146
post #136

Earlier quoted context omitted.

[deleted]

I'm referring to the commit to which I initially replied: https://news.ycombinator.com/item?id=22935985 "...is it time to move away from Github?"

Yeah, I reread your comment, but you responded before I deleted apparently :-) My mistake.

Re: GitHub is degraded/down

#147

Earlier quoted context omitted.

If you're looking for somewhere else, SourceHut has had no unplanned outages in 2020, despite being kept online by an army of one. The software and infrastructure is just more resilient and better maintained. Our ops guide is available here: https://man.sr.ht/ops/ It's also the highest performance software forge by objective measures: https://forgeperf.org/ Full disclosure: I am the founder of SourceHut.

A little bit off topic. I just wondering it support git write access over https? Not just read only.

No, write access is only supported over SSH, for security reasons. SSH key authentication is stronger than password authentication, and git.sr.ht doesn't have access to your password hash to check anyway.

Re: GitHub is degraded/down

#148
post #60

Earlier quoted context omitted.

Should only be 2-3 PB. Storing it all on https://tardigrade.io

Only 3 petabytes? At $0.01/GB/Month, it seems that works out to about $360,000/year in storage costs alone. Cheers, but you're paying for this just as a public service?

There is discount pricing over 100 TB. Its a tech demo so Tadigrade.io sponsors it. Pretty powerful demo on easily storing large amounts of data especially when Github goes down.

Re: GitHub is degraded/down

#149

Earlier quoted context omitted.

About 18K git & hg repositories, for about 13.5K users. We also run about 5,000 CI jobs per week, including for some large projects like Nim and Zig, Neovim, OpenSMTPD, etc. We have 10 dedicated servers at the moment. And I didn't throw an open source solution on these servers - I built these open source services from the ground up.

So you're comparing your scalability with a company with over 40m users and 100m repos. Can you talk about the geographic distribution of your 10 servers?

I would like to remind you of my earlier point:

SourceHut is not the same scale as GitHub. This does not change the fact that SourceHut is faster and more reliable. We have an advantage - fewer users and repos - but still, that doesn't change the fact that we're faster and more reliable.

This has been objectively demonstrated as a numerical fact:

https://forgeperf.org

And yes, 9 of those servers are in Philadelphia (the other is in San Franscisco, but it's for backups, not distribution). That doesn't change the fact that, despite being more distant from many users, our pages load faster. In this respect, we have a disadvantage from GitHub, but we're still faster.

GitHub and Sourcehut are working at different scales. That doesn't change the fact that SourceHut is faster.

Re: GitHub is degraded/down

#150
post #21

Earlier quoted context omitted.

No, I don't think so (and I'm also in Minnesota). I'm going to guess that the increased load is just pushing services over the edge. Edit: Also, interestingly enough, I am now reliably hitting Cloudflare's ORD (Chicago) datacenter instead of MSP. If you visit https://snazz.xyz/cdn-cgi/trace (or any other Cloudflare-backed website), what comes after the COLO= for you?

You can test Cloudflare at https://cloudflare-test.judge.sh/#snazz.xyz

So ORD is probably just higher-capacity, which is why free plan users like me are getting routed to it?
Post reply on HN