GitHub was down • Hacker News Board

Re: GitHub was down

#21

Post by Insanity » Mon, Jul 13, 2020, 7:20 AM UTC

kenhwang wrote: post #12

lprd wrote: post #8

This is slowly becoming a weekly occurrence ever since Microsoft entered the picture... https://www.githubstatus.com/

I remember it being a weekly occurrence before Microsoft as well. edit: though their historical data doesn't back it up. It's just a 2020 thing it seems; coincidentally picked up right near the middle of February which correlates way too closely with the beginning of COVID.

correlation != causation though.

Re: GitHub was down

#22

Post by pcr0 » Mon, Jul 13, 2020, 7:20 AM UTC

quantummkv wrote: post #9

Surely it can't be a coincidence that Github is down every other week after the Microsoft acquisition? Is Microsoft interfering too much? Or did the core technical expertise leave for other greener pastures in Microsoft or outside?

I believe GitHub's been adding new features much faster after the Microsoft acquisition. Moving faster can lead to breaking things more frequently.

Re: GitHub was down

#23

Post by goldfishlover » Mon, Jul 13, 2020, 7:20 AM UTC

quantummkv wrote: post #9

Surely it can't be a coincidence that Github is down every other week after the Microsoft acquisition? Is Microsoft interfering too much? Or did the core technical expertise leave for other greener pastures in Microsoft or outside?

probably overly complicated layers-upon-layers of services, infrastructure and feature creep fighting with each other

Re: GitHub was down

#24

Post by thaumasiotes » Mon, Jul 13, 2020, 7:21 AM UTC

thayne wrote: post #18

nicc wrote: post #11

People are advocating hosting their own Git repos, but wouldn't those go down, too, and wreck the day even more? Or, are you guys all devops geniuses better than those who work at GitHub?

Well, if you host it yourself, and it goes down, then you have control over getting it back up, rather than waiting for someone else to fix it. Though really, if it is that important for it to be up, you should mirror it to at least one other provider (ex. self-hosted and github).

I did work somewhere once with GitLab self-hosted in a VM. The person in charge believed it was important to reboot the VM every so often.

One day, for whatever reason, he couldn't bring the VM back up. Self-hosted GitLab was out for the rest of the day. I found this pretty funny.

Re: GitHub was down

#25

Post by nicc » Mon, Jul 13, 2020, 7:24 AM UTC

navanchauhan wrote: post #19

nicc wrote: post #11

People are advocating hosting their own Git repos, but wouldn't those go down, too, and wreck the day even more? Or, are you guys all devops geniuses better than those who work at GitHub?

Umm, so if you are hosting your own Git Repos, and not fiddling with the configurations much once you have found the perfect fit. Isn't the only reason it will go down be because of network issues or power failure? What other possible cause could be for system failure? I have been running HA, Pi-Hole, Maria-DB and my own API instances on my Raspberry Pi and in the 22 days of uptime till now, there have been 0 failure…

Many reasons, including your hosting provider going down.

At that point you'd have to create and manage a cluster.

You have to update servers, etc. etc. and if you count the hours is many times more than working locally and wait a couple of hours until technicians at GitHub fix the problem for you.

Re: GitHub was down

#26

Post by darkwater » Mon, Jul 13, 2020, 7:25 AM UTC

nicc wrote: post #11

People are advocating hosting their own Git repos, but wouldn't those go down, too, and wreck the day even more? Or, are you guys all devops geniuses better than those who work at GitHub?

Absolutely not, but I guess that most of "internal repos" access patterns are widely less trafficked than GH. So, it's not that difficult to have a "stable enough" configuration for most organizations. Sure, for a 5-10 devs shop it's overkill, but if you have a mid-sized team and already having someone caring for internal tooling/systems, it's not that a bad idea. Unless you have the "hosted here" syndrome.

Re: GitHub was down

#27

Post by rvz » Mon, Jul 13, 2020, 7:27 AM UTC

I said this before many times and I'll say it again, consider self-hosting your projects on a solution like GitLab or Gitea to avoid this sort of situation. [0]

GNOME, Xfce, Redox, Wireguard, KDE and Haiku all have self-hosted on either cgit, Gitlab, Phabricator or Gitea.

[0] https://news.ycombinator.com/item?id=23676072

Re: GitHub was down

#28

Post by _ikke_ » Mon, Jul 13, 2020, 7:27 AM UTC

navanchauhan wrote: post #13

jonny383 wrote: post #10

Earlier quoted context omitted.

I was going to warn you about SD card corruption, but then I realized even this is probably more reliable than GitHub at this point.

I personally haven't experienced any SD card corruption, even though I am running a Maria-DB instance, Home-Assistant instance and a Pi-Hole instance on a Pi Zero with a 32 gig SD Card ( 23 days uptime as of writing )

I've had 2 sd-cards go corrupt (read-only, any writes were lost). Had a mariadb instance running on it as well. It will hold for for some time, but eventually, the card will give up.

Re: GitHub was down

#29

Post by numpad0 » Mon, Jul 13, 2020, 7:30 AM UTC

nicc wrote: post #11

People are advocating hosting their own Git repos, but wouldn't those go down, too, and wreck the day even more? Or, are you guys all devops geniuses better than those who work at GitHub?

You get to spend time fixing it rather than waiting it done :p

Re: GitHub was down

#30

Post by quyleanh » Mon, Jul 13, 2020, 7:30 AM UTC

I still don't understand people who always mentions to Microsoft's acquisition. Until the official statement, it isn't Microsoft failure. Don't blame them.