No matter how many talented engineers you have on staff, your entire service can still go down. Let's pause and reflect on that. ;)
could learn a few things from Netflix and chaos engineering...
GitHub was down
101–110 of 171 posts
Re: GitHub was down
#102Earlier quoted context omitted.
> How do we calculate Uptime? > Our Uptime calculation is based on the percentage of successful requests we serve through our web, API, and Git client interfaces. Just curious, how do they measure this? What is the actual calculation?
What do you mean? All modern enterprise analytics/monitoring solutions are going to be able to give you some kind of top-level "request success rate" metric. I assume they mostly just lean into whatever monitoring tooling they have set up. What kind of "calculation" are you imagining here? Like a very specific SRE formula for availability windows or something?
It means their SLA bases on non 5xx and connection errors?
Re: GitHub was down
#103Earlier quoted context omitted.
"You can't legislate against failure, but you can focus on fast detection and response" -- Chris Pinkham
It’s amazing how this is accepted in the software world. Move fast and break things, such a different philosophy to other areas.
I think the quote from Pinkham is more about dealing with genuinely unavoidable failures, not those due to moving without appropriate due diligence.
Re: GitHub was down
#104>We continue to investigate the issues with GitHub services and will shift to a slower update cadence to provide more meaningful updates going forward. Translation: our shitty software update practices are now affecting Github, not just Windows! If anyone from Microsoft is reading this, why is your company so incompetent at software updates in the past few years?
Is it not ostensibly the same company, just with a new owner...?
Initially, but that is subject to change or more likely evolve over time.
Re: GitHub was down
#105Earlier quoted context omitted.
Still miles better than BitBucket.
When was the last time BitBucket had an outage? Personally I don't see a lot of difference between the two platforms; or GitLab (my primary now). Github probably has the best UI, but Gitlab's has gotten a lot better; and there are always self hosted solutions like Gogs.
I've also much preferred GitLab's GUI. It seemed to be much cleaner and smoother than Githubs (not to mention the much better named Merge Request).
Re: GitHub was down
#106Earlier quoted context omitted.
What do you mean? All modern enterprise analytics/monitoring solutions are going to be able to give you some kind of top-level "request success rate" metric. I assume they mostly just lean into whatever monitoring tooling they have set up. What kind of "calculation" are you imagining here? Like a very specific SRE formula for availability windows or something?
It means their SLA bases on non 5xx and connection errors?
I mean that seems like a question to ask an account rep? I'm sure it's also probably not a hard and fast rule for every single customer, hence the ambiguity in the general language.
Re: GitHub was down
#107Earlier quoted context omitted.
Same here. They obviously don't have beacons on the client side, I wonder if it's based on statistics, at this time of the day on a Tuesday we should be getting x requests but are getting only x/n.
> They obviously don't have beacons on the client side Says who?
Client side beacons would have to be implemented in the git client, and making parallel requests. I've seen no evidence of it myself, and I'd think people would freak out if found inside git's source.
Re: GitHub was down
#108Don't forget to check your SLAs Enterprise = 99.95% (quarterly) https://help.github.com/en/github/site-policy/github-enterpr... They're having a bad February but January was good. We will see what March has in store
Nothing quite like the “maybe” credit backed SLA.
Re: GitHub was down
#109Re: GitHub was down
#110Earlier quoted context omitted.
IME GitHub has not had increased downtime after Microsoft's acquisition.
Well, some other people in the comments disagree. And it hasn't happened yet, but it's the way they don't manage / integrate acquisitions very well unless they're wowie complementary products like Visio. Danger dropped off a cliff and Softricity was absolutely amazing but shelved, so friends of mine basically repeated the theme for VMware View and were acquihired by VMware. Time will tell where GH goes.
>Softricity was absolutely amazing but shelved
Why do you say that? I thought it was just renamed App-V and it's still going strong to this day. https://docs.microsoft.com/en-us/windows/application-managem...