That moment when you submit a very long comment on GitHub, and realise that it is down. :(
GitHub was down
41–50 of 129 posts
Re: GitHub was down
#42Looks like they need some high level analysis on why these outages happen so often. At this point it feels like it’s no longer a series of accidents and that they should improve something.
It's important to note that it's the website that is down. Git itself worked through all the outages I can remember. Unfortunately, at least the last time I think, the integrations didn't.
Re: GitHub was down
#43I have noticed a pattern than when I generate markdown from org-mode and have the text 'language' selected for highlighting push, this causes github to hang like crazy. I don't think I'm crazy in thinking it might be me. I push frequently to my blog and am starting to notice a correlation.
I export this into the below markdown.
#+BEGIN_SRC text -n :f "translate-shell -s fr -t en" :async :results verbatim code
I learned some French so that I can talk to
you during tennis. I hope I know enough so you
will not get bored.
#+END_SRC
This is the markdown which was pushed to my blog. The 'Page Build failure' messages take a long time to arrive to my inbox and I can see that the page build is hanging.
{{}}
I learned some French so that I can talk to
you during tennis. I hope I know enough so you
will not get bored.
{{}}Re: GitHub was down
#4414 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072
I would choose self-hosting for small to medium size teams any day. I can't fathom why people choose not to self-host at this scale. Your data. Your control. Your network. Your infrastructure. Your responsibility. Are people becoming more afraid of responsibility these days?
Small to medium size teams should be hyper-focused on developing their product and bringing in customers and revenue. Spending time on commoditized infrastructure is only a good idea if that saves time in the short to medium term.
But hey, with the number of outages GitHub has recently that break even point is coming closer and closer.
Re: GitHub was down
#4514 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072
Could you provide details on how you plan to be more reliable with a self-hosted solution? what kind of archtecture would you use? how many people will be involved in maintaining?
It's not that I'm against, the contrary, but in the last months I've experienced a physical server crash, a random kernel panic and a failed upgrade of GitLab: that all took 10/20 hours of work, didn't result in any data loss, but the downtime was clearly higher than what GitHub has (+ nobody on the team was on holidays at that moment), plus any maintenance like software or system upgrades has to be done outside team working hours to limit the impact.. real self-hosting is not that easy!
Re: GitHub was down
#46Seems like things started to go down the drain somewhere around February 2020. https://www.githubstatus.com/uptime/kr09ddfgbfsf?page=2 Wonder what was the trigger for the reliability hit - actions went GA on nov 2019, so it's something else (or possibly a combination of things)
[deleted]
Re: GitHub was down
#4714 Days ago, they went down [0]. And today it's happening again. Twice in less than a month. Another reminder to self host via solutions like GitLab or Gitea. [1] [0] https://news.ycombinator.com/item?id=23675864 [1] https://news.ycombinator.com/item?id=23676072
self-hosting requires quite a bit of scale to be more reliable, otherwise you'll most likely still have possibly longer outages, just at different times.
I mean, hardware nowadays is quite reliable. We have a simple server with three disks in raid1, and it basically just works. Gitlab has regular backups, so at worst we would have one day of lost work.
Re: GitHub was down
#48Seems to me like a Deja-Vu after I answered this[1] on quora yesterday.
[1] https://www.quora.com/Github-now-allows-unlimited-private-re...
Re: GitHub was down
#49Earlier quoted context omitted.
Out of curiosity, what could have Microsoft done to cause this? I'm not aware of the acquisition details. But did they make GitHub switch to Azure or make significant changes to infrastructure? I've seen several people blaming Microsoft for GitHub outages and am trying to understand why this is a common thing.
Yes. Github used to be hosted on AWS. Now,they have migrated (at least partially) to Azure.
there isn't an azure outage right now.
Re: GitHub was down
#50Seems like things started to go down the drain somewhere around February 2020. https://www.githubstatus.com/uptime/kr09ddfgbfsf?page=2 Wonder what was the trigger for the reliability hit - actions went GA on nov 2019, so it's something else (or possibly a combination of things)
They started doing availability reports. Las months details in the blog post below with summary of the issue.
Stay tuned till next month for the current outage.
https://github.blog/2020-07-08-introducing-the-github-availa...