Live data from Hacker News

GitHub having issues today

githubstatus.com

11–20 of 89 posts

Re: GitHub having issues today

#11

And just as we're about to migrate 4 kubernetes clusters with a total of ~4k pods. Terraform in github actions on selfhosted runners and argoCD is failing.

Oh that sucks, there's always going to be those who will say that it's the price you pay for using Github, but locally hosted VCS and CI/CD systems have issues as well.

External dependencies are always problem, but do you have the capacity and resources required to manage those dependencies internally? Most don't and will still get a better product/service by using an external service.

Re: GitHub having issues today

#12
post #7

The fact that Github has been so unstable for so long is absolutely insane to me. I know ops is hard, but this level of consistent outage points to an endemic problem. Is it the legacy rails/mysql stack that is the largest culprit or is there systemic rot in the engineering org?

More likely, it's efforts to migrate away from the previously solid Rails stack to MS's preferred stack. They've had a long history of this kind of stability issue when migrating or trying to migrate acquisitions from their previous stack to an MS one. This happened with Hotmail (Unix server -> Windows server), LinkedIn (custom cloud -> MS cloud) and others since.

Is Github moving to .Net and/or SQLServer, or is it "just" moving everything to Azure?

Re: GitHub having issues today

#13
It really feels like the frequency of this happening has increased lately. Are they facing high employee turnover?

_Maybe it’s time for rewriting it in Rust._

Edit: RIIR was said in jest. I forgot HN doesn’t support markdown.

Re: GitHub having issues today

#14
post #7

The fact that Github has been so unstable for so long is absolutely insane to me. I know ops is hard, but this level of consistent outage points to an endemic problem. Is it the legacy rails/mysql stack that is the largest culprit or is there systemic rot in the engineering org?

Why people think it can be related to Rails when there are tons of companies out there using Rails not affected by this degradation?

Re: GitHub having issues today

#15

It really feels like the frequency of this happening has increased lately. Are they facing high employee turnover? _Maybe it’s time for rewriting it in Rust._ Edit: RIIR was said in jest. I forgot HN doesn’t support markdown.

Full stack re-writes are not always the best way. Sometimes you end up with worse. Sometimes you end up with better. If you do go the 'full stack rewrite' you better have a decent plan in place. Because you are about to get to support 2 code bases for awhile.

edit: fair enough

Re: GitHub having issues today

#18

It really feels like the frequency of this happening has increased lately. Are they facing high employee turnover? _Maybe it’s time for rewriting it in Rust._ Edit: RIIR was said in jest. I forgot HN doesn’t support markdown.

Full stack re-writes are not always the best way. Sometimes you end up with worse. Sometimes you end up with better. If you do go the 'full stack rewrite' you better have a decent plan in place. Because you are about to get to support 2 code bases for awhile. edit: fair enough

I'm pretty sure (hope?) the comment was said _in jest_ (though I'm not familiar with _this internet standard_)

Re: GitHub having issues today

#20

And just as we're about to migrate 4 kubernetes clusters with a total of ~4k pods. Terraform in github actions on selfhosted runners and argoCD is failing.

That's where I feel like it's actually pretty nice to not have CI tied to your source code. It's probably more expensive to use Travis/Circle but at least you don't have a single point of failure for deploys.
Post reply on HN