Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub was down

githubstatus.com

Post reply on HN
Print view View original

121–130 of 171 posts

Re: GitHub was down

#121

Post by leadingthenet »

stevekemp wrote: post #92
djsumdog wrote: post #31

Earlier quoted context omitted.

When was the last time BitBucket had an outage? Personally I don't see a lot of difference between the two platforms; or GitLab (my primary now). Github probably has the best UI, but Gitlab's has gotten a lot better; and there are always self hosted solutions like Gogs.

I'm pleased I don't have to deal with BitBucket any more, but back a year or two it felt like it had an outage that impacted work at least once every six months. Sure that might not sound like much, but it was always a pain. Plus of course the service was so damn slow that using it was a daily pain.

There's a yellow banner (that you can't even close) shown every few weeks, and it's usually related to the Pipelines being down, again. That often results in degrading functionality in other parts of the project too. And it's still slow as molasses. I wish I'll never have to use Bitbucket again, in the future.

Re: GitHub was down

#122

Post by masklinn »

djsumdog wrote: post #29
giancarlostoro wrote: post #7

Earlier quoted context omitted.

They seem to be doing heavy work on it. Now on Mobile you can't see repos in "Desktop Mode" which is unfortunate. I have to tell my browser to pretend to be in desktop mode. Plus the regex post from the other day seems to imply they are working on new things when somebody from GH replied in said thread. I don't mind improvements, but don't break production guys...

They also changed the "Group Membership" dialog to be paginated when you add a new person to an organization. We have over 200 groups so now I have to page through for ever new hire we add. There's not even a search option. I'm sure the pagination might better for performance, but it's terrible UI.

They may have missed that one, because at the same time they introduced both pagination and search to the repository membership page, and boy did that help us on one of our repos with a few hundred direct collaborators, by the end we could only manage access through the API because the page didn't even load most of the time.

Re: GitHub was down

#123

Post by MetalMatze »

bradstewart wrote: post #85
Benjammer wrote: post #74

Earlier quoted context omitted.

What do you mean? All modern enterprise analytics/monitoring solutions are going to be able to give you some kind of top-level "request success rate" metric. I assume they mostly just lean into whatever monitoring tooling they have set up. What kind of "calculation" are you imagining here? Like a very specific SRE formula for availability windows or something?

Depending on what part of the system is down, how do you know you even got a request to mark as failed?

You want to start measuring the closet to your users. In most cases that would be some sort of load balancer. I don't think there's much we can do without going to the client side.

Re: GitHub was down

#124

Post by erikbye »

bbrree66 wrote: post #56
anonsivalley652 wrote: post #39

Earlier quoted context omitted.

Well, some other people in the comments disagree. And it hasn't happened yet, but it's the way they don't manage / integrate acquisitions very well unless they're wowie complementary products like Visio. Danger dropped off a cliff and Softricity was absolutely amazing but shelved, so friends of mine basically repeated the theme for VMware View and were acquihired by VMware. Time will tell where GH goes.

There are so many logical flaws here. People's comments are meaningless, you can look at historical GitHub up-time and see that it hasn't changed meaningfully. "And it hasn't happened yet" Ah yes, now you have to backtrack from: it happened! to... no wait I promise it will happen! Based on... what? The fact that some acquisitions don't go well? This is all pure speculation with no substantiation. I recommend learning…

I agree, but I just now took a look here: https://www.githubstatus.com/uptime?page=7

I went back from the time of Microsoft's acquisition, and that status seems heavily underreported. At least when I checked now, it was all green, green. That does not reflect my experience.

Re: GitHub was down

#125

Post by masklinn »

donkeydoug wrote: post #96
bflesch wrote: post #16

Are they migrating to azure?

I had the same guess... migrating from aws to azure & hitting some bumps. Have to assume they won't be very forthcoming about it if that is the reason.

> migrating from aws to azure & hitting some bumps

Could be the IO? I remember colleagues working on getting stuff running on azure and they experienced horrible IO latency, as well as very low throughput for lots of small IO (aka unix-style software).

Was a few years back so it might have improved since, but if those things are still non-optimal and github is built with a unix-style vision of tons of small IO access…

This specific outage taught me that github apparently stores git repos on-disk which I was not expecting though (because the API access complained it could not delete repos until they'd fully backed to disk or something).

Re: GitHub was down

#126

Post by dvdhnt »

Well, given the timing of GitHub reliability issues over the last few days, I think we can all agree it has everything to do with dates and timezones?

/s

Appreciate the work.

Re: GitHub was down

#127

Post by zeta0x10 »

natfriedman wrote: post #116

Sincere apologies to all GitHub users for the downtime this morning, and the brief outages last week as well. We take reliability very seriously, and will publish a full RCA in the near future.

At least your main competitor's uptime metrics are also pretty bad, so fingers crossed.

Re: GitHub was down

#128

Post by MrMorden »

salmon30salmon wrote: post #79
ArchReaper wrote: post #73

>We continue to investigate the issues with GitHub services and will shift to a slower update cadence to provide more meaningful updates going forward. Translation: our shitty software update practices are now affecting Github, not just Windows! If anyone from Microsoft is reading this, why is your company so incompetent at software updates in the past few years?

You honestly believe that a company the size of GitHub has had their software update practices appreciably change since the acquisition? Relax, GitHub had update issues before and they will have them again.

All of this has happened before and all of this will happen again. So say we all.

Re: GitHub was down

#129

Post by pimlottc »

briffle wrote: post #57
anonsivalley652 wrote: post #35

When Microsoft buys companies, they tend to progressively decay as the original architects leave, the morale of remaining employees grinds down from the stress and they bring in cheaper contractors to duct tape the bits together and plug the holes in levee with their fingers. I've BTDTBTTS. cough LinkExchange, WebTV, Hotmail, Skype, Softricity, Nokia, LinkedIn, Danger/Sidekick cough GH maybe next. ¯\_(ツ)_/¯

That has nothing to do with Microsoft. That is ANY large merger. 1. Nothing is going to change. We bought this company because we love it 2. We need to show a higher profit for this quarter, cut all expenses for every subsidiary by 15% by Friday 3. Cut back on training, R&D, and support teams. they are a huge cost center 4. Bunch of employees leave after retention bonuses, replaced with MUCH cheaper labor 5. Need to…

Can you remove the leading spaces causing your comment to appear in a code block? It’s quite hard to read on mobile. Thanks!
Post reply on HN