Live data from Hacker News

GitHub was down

status.github.com

81–90 of 129 posts

Re: GitHub was down

#81
post #71

Earlier quoted context omitted.

You know if you use Microsoft products every day, and every day they let you down, and every day you experience the worst most unintuitive design in the world, and every day you have to deal with their reliability issues, and then MS acquires github, and github starts to behave like everything else MS touches ... Clearly something about how MS runs is responsible for their past outcomes, why is it a stretch to assume…

It's just your own feelings. I haven't had any issue with Microsoft products (and yes I use their services every day in my working life). All I can see from you is making a guess with your full of sentiments and negative thoughts. So as I said, don't blame them until official statement.

> It's just your own feelings.

Nope. Github is down, I don't feel it is down, it is down. Office 365 falls apart when two people try edit a spreadsheet at once. Outlook does not allow you to unreject a meeting invite. Windows won't report DLL errors over a powershell terminal, Azure takes 10 minutes to delete a VM instance, Azure DevOps is so poorly designed that nobody can figure out how to find a repo without someone explaining it to them first, I can go on, but none of this is my feelings, these are actual things that people have to put up with from MS every day.

Re: GitHub was down

#82

Move off Rails now GitHub, is clearly not working for you. It took you this far, now go move to something that doesn't sh*ts the bed twice every month.

Flask (python) or even CodeIgniter (php) are my frameworks of choice for this sort of thing. They may be a bit old and organizing a large project could be difficult but nothing can beat them on performance!

Indeed. Anything that has so much magic in it is bound to bite you in the a. There will be a time when there is so much code and magic that no one really understands the system well.

Twitter too was on Rails in the initial days which helped it took off, and then realised they need to move to JVM(Scala) to scaled and they have been performing brilliantly since then.

Now, that MS has bought them, why don't they use the brilliant tech MS has (.NET, .NET Core) and be more reliable?

Re: GitHub was down

#83

Move off Rails now GitHub, is clearly not working for you. It took you this far, now go move to something that doesn't sh*ts the bed twice every month.

Rails is (apparently still) a popular target for haters, but for projects at Github's scale it's rarely a code logic/framework-level blunder that's taking the service down. It's generally a cascade of failures in things like multiple database systems, auto-scaling, dns/caching, etc.

There are projects bigger than GitHub that do all of these things and still doesn't fail as much as GitHub. Honestly, both of us speculating. You can't say for sure if it's not Rails and I can't say if it's not anything else.

> for projects at Github's scale it's rarely a code logic/framework-level blunder that's taking the service down. It's generally a cascade of failures in things like multiple database systems, auto-scaling, dns/caching, etc.

This is just guessing. You can't honestly tell what is causing the issue.

Re: GitHub was down

#85
post #13

14 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072

Self hosting GitHub is an option as well. We've been self hosting GitHub Enterprise for years and it has had no downtime other than during scheduled updates (at night, when nobody's at work).

Re: GitHub was down

#86
post #78

Well, there goes my night. I was waiting on a build triggered by Github actions and was wondering what was up. I guess this is my sign to get some sleep. Microsoft needs to slow things down and focus on stability. This really isn't good. I need these weekend and late night hours for my side hustle. I already have enough trouble as is, I don't need an injection of additional difficulty. (That's just my frustration; I…

Why are you not using an alternative?

Re: GitHub was down

#87

Seems like things started to go down the drain somewhere around February 2020. https://www.githubstatus.com/uptime/kr09ddfgbfsf?page=2 Wonder what was the trigger for the reliability hit - actions went GA on nov 2019, so it's something else (or possibly a combination of things)

COVID related work from home adjustments is my guess.

That might be the trigger but it wouldn't be the root cause.

For example web and backend servers for cloud services shouldn't be affected by whether people are sat in one location or another. However if those systems requires lots of maintenance to keep running and people are less available due to COVID then you'd see a rise in downtime. But that would mean it's not COVID that's the problem, it's the amount of maintenance required and COVID only surfaced that problem.

Re: GitHub was down

#88
post #13

14 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072

Self hosting GitHub is an option as well. We've been self hosting GitHub Enterprise for years and it has had no downtime other than during scheduled updates (at night, when nobody's at work).

> We've been self hosting GitHub Enterprise for years and it has had no downtime other than during scheduled updates (at night, when nobody's at work).

Is it free to self host like GitLab or Gitea? If not, what does it offer that you can't get from those?

Re: GitHub was down

#89
post #26
post #13

14 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072

You can self-host GitHub too. Or BitBucket.

> Or BitBucket

But why would anybody ever do that?

Re: GitHub was down

#90
post #33
post #13

14 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072

I would choose self-hosting for small to medium size teams any day. I can't fathom why people choose not to self-host at this scale. Your data. Your control. Your network. Your infrastructure. Your responsibility. Are people becoming more afraid of responsibility these days?

This assumes that develop / ops team is no cost and that your uptime would be higher (it wouldn't)
Post reply on HN