GitHub Is Down • Hacker News Board

Re: GitHub Is Down

#31

Post by rvz » Thu, Apr 02, 2020, 8:48 PM UTC

I don't see the point for major open-source projects or even company projects to depend on a third-party provider for git services in the cloud that is not on-premise. It's fine if the source code is self-hosted or on premise and the mirror is hosted on some cloud VCS like Github, but not the other-way round, which for the latter you risk getting problems like this.

The case for self-hosting a VCS server for serious projects is made once again.

Re: GitHub Is Down

#32

Post by geerlingguy » Thu, Apr 02, 2020, 8:48 PM UTC

amarshall wrote: post #29

ogre_codes wrote: post #21

Apparently the earlier thread about Microsoft's cloud stability was a bit prescient.

Has GitHub moved their infrastructure to Azure? Last I recall they ran mostly on their own servers.

I'd imagine the higher volume due to remote work (e.g. people collaborating more on issues and such who may have communicated in person previously) is also a contributing factor.

From the sound of their earlier 'not postmortem but we'll do one soon', it sounded like they currently have a database tier that's creaking at its foundations, and I'd guess any time there's extra strain or someone pushes a fix to the GitHub codebase that adds a tiny bit of unoptimized code, it strains it past the limit.

Re: GitHub Is Down

#33

Post by mattrick » Thu, Apr 02, 2020, 8:52 PM UTC

rvz wrote: post #31

I don't see the point for major open-source projects or even company projects to depend on a third-party provider for git services in the cloud that is not on-premise. It's fine if the source code is self-hosted or on premise and the mirror is hosted on some cloud VCS like Github, but not the other-way round, which for the latter you risk getting problems like this. The case for self-hosting a VCS server for serious…

I can understand this sentiment, but a lot of projects and companies (especially startups) want something that "just works" and not something that they'll need to invest resources into maintaining. Something like this can happen on your self-hosted git server and you won't have an SLA or anything to fall back on.

Re: GitHub Is Down

#34

Post by jayd16 » Thu, Apr 02, 2020, 8:53 PM UTC

rvz wrote: post #31

I don't see the point for major open-source projects or even company projects to depend on a third-party provider for git services in the cloud that is not on-premise. It's fine if the source code is self-hosted or on premise and the mirror is hosted on some cloud VCS like Github, but not the other-way round, which for the latter you risk getting problems like this. The case for self-hosting a VCS server for serious…

Github (and gitlab) has a large value add with regard to discoverability, issue tracking, user management, hosting simplicity, and usually solid uptime.

Re: GitHub Is Down

#35

Post by notacoward » Thu, Apr 02, 2020, 8:53 PM UTC

rvz wrote: post #31

I don't see the point for major open-source projects or even company projects to depend on a third-party provider for git services in the cloud that is not on-premise. It's fine if the source code is self-hosted or on premise and the mirror is hosted on some cloud VCS like Github, but not the other-way round, which for the latter you risk getting problems like this. The case for self-hosting a VCS server for serious…

GitHub addiction is not just about git itself. It's about the entire ecosystem of pull requests, issues, forking, linking to related projects, CI integrations, hosting for docs, and so on, all integrated under one sign-on umbrella. It is awfully convenient. Yes, for sure you can self-host one of the alternatives like GitLab, or assemble an equivalent set of services from smaller parts. It is absolutely reasonable to suggest that people should - I'm even inclined to agree - but comparing against git all by itself is the wrong comparison.

Re: GitHub Is Down

#36

Post by [deleted] » Thu, Apr 02, 2020, 8:54 PM UTC

gargarplex wrote: post #17

I wrote some open source code to automatically mirror all my commits to Keybase. I think read replica mirrors are good practice for fault-tolerant systems

[deleted]

Re: GitHub Is Down

#37

Post by gramakri » Thu, Apr 02, 2020, 8:54 PM UTC

We use a self-hosted GitLab ourselves and I can honestly say we have more up time than GitHub.

But 9/10 every project we use is on GitHub and our work is stalled. Centralization will be our downfall :(

Re: GitHub Is Down

#38

Post by sgt » Thu, Apr 02, 2020, 8:54 PM UTC

elwell wrote: post #26

Seems to be back up now.

Still down for me

Re: GitHub Is Down

#39

Post by rad_gruchalski » Thu, Apr 02, 2020, 8:55 PM UTC

fezzez wrote: post #30

ahnick wrote: post #23

Earlier quoted context omitted.

link?

it's probably on github

Hopefully does not depend on github webhooks for replication!

Re: GitHub Is Down

#40

Post by senko » Thu, Apr 02, 2020, 8:58 PM UTC

rvz wrote: post #31

I don't see the point for major open-source projects or even company projects to depend on a third-party provider for git services in the cloud that is not on-premise. It's fine if the source code is self-hosted or on premise and the mirror is hosted on some cloud VCS like Github, but not the other-way round, which for the latter you risk getting problems like this. The case for self-hosting a VCS server for serious…

Unless you have the (ops) capacity to host it yourself reliably, chances are GitHub will be up more than your self-hosted solution.

As I'm typing this, I'm waiting for GitHub to recover so I can deploy an update to a rather important project for a big client. However, I'm happy it's their engineers to be scrambling to fix their git hosting, instead of me context switching from my work and rushing to duct-tape piece of plumbing I really don't care to think about.