I've been noticing the issue they're describing for a few days now, with errors in GitHub Actions requiring rebuilds and webhooks not seeming to fire which caused Jira to go out of sync.
Mssql only once guaranteed delivery in action?
GitHub was down
141–150 of 171 posts
Re: GitHub was down
#142What do you guys recommend as a good way to continue work undisrupted when GitHub goes down? A second remote mirror?
Git or fossil mesh.
Re: GitHub was down
#143Earlier quoted context omitted.
They seem to be doing heavy work on it. Now on Mobile you can't see repos in "Desktop Mode" which is unfortunate. I have to tell my browser to pretend to be in desktop mode. Plus the regex post from the other day seems to imply they are working on new things when somebody from GH replied in said thread. I don't mind improvements, but don't break production guys...
They also changed the "Group Membership" dialog to be paginated when you add a new person to an organization. We have over 200 groups so now I have to page through for ever new hire we add. There's not even a search option. I'm sure the pagination might better for performance, but it's terrible UI.
They really need beta.github.com to let people test changes that are not yet defacto. A uservoice type of thing, and the ability for people to join. I love to beta test and give feedback. Microsoft has used uservoice in the past, as has Sulake and other companies I've beta tested for (as a customer).
Edit:
Realized *.github.com takes you to your .github.io sites.
Re: GitHub was down
#144Sincere apologies to all GitHub users for the downtime this morning, and the brief outages last week as well. We take reliability very seriously, and will publish a full RCA in the near future.
> […] downtime this morning, and the brief outages last week as well.
For context, there were four (public) incidents this week:
• Incident on Feb 27, 14:31 until 18:54 UTC - https://www.githubstatus.com/incidents/q07bfjh7jf1t
• Incident on Feb 25, 16:36 until 18:48 UTC - https://www.githubstatus.com/incidents/xp2qc958g4wt
• Incident on Feb 20, 21:31 until 22:16 UTC - https://www.githubstatus.com/incidents/bd29l6zgr43g
• Incident on Feb 19, 15:17 until 16:09 UTC - https://www.githubstatus.com/incidents/fxbbtd7mhz1c
Re: GitHub was down
#145Sincere apologies to all GitHub users for the downtime this morning, and the brief outages last week as well. We take reliability very seriously, and will publish a full RCA in the near future.
What did you guys deploy/what scale tipping point did you guys hit that caused the past 3 days of problems? At my job, if something we go wrong... management just tells us roll it back. That always fixes the problem, right? :P
Yep, it is Dunning-Kruger effect.
If rolling back works for a simple system, why wouldn't it work for a complex one?
Because one cannot step into the same river twice. Heraclitus would probably make a good engineering manager.
Re: GitHub was down
#146Earlier quoted context omitted.
Still miles better than BitBucket.
When was the last time BitBucket had an outage? Personally I don't see a lot of difference between the two platforms; or GitLab (my primary now). Github probably has the best UI, but Gitlab's has gotten a lot better; and there are always self hosted solutions like Gogs.
Github's diffs are pretty much instantaneous, Bitbucket just gives up, "now that's a lot of code!". No, it was a one line change actually.
Re: GitHub was down
#147Re: GitHub was down
#148Earlier quoted context omitted.
What did you guys deploy/what scale tipping point did you guys hit that caused the past 3 days of problems? At my job, if something we go wrong... management just tells us roll it back. That always fixes the problem, right? :P
Yep, it is Dunning-Kruger effect. If rolling back works for a simple system, why wouldn't it work for a complex one? Because one cannot step into the same river twice. Heraclitus would probably make a good engineering manager.
This is 100% not the Dunning-Kruger effect. How on Earth would it be?
edit - from wikipedia: In the field of psychology, the Dunning–Kruger effect is a cognitive bias in which people assess their cognitive ability as greater than it is.
Re: GitHub was down
#149Sincere apologies to all GitHub users for the downtime this morning, and the brief outages last week as well. We take reliability very seriously, and will publish a full RCA in the near future.
Well Bitbucket lost all of my repositories this morning so you've got a long way to fall
Re: GitHub was down
#150Sincere apologies to all GitHub users for the downtime this morning, and the brief outages last week as well. We take reliability very seriously, and will publish a full RCA in the near future.
Do you guys ever miss meritocracy?