Live data from Hacker News

GitHub Broken Download URLs

github.com

91–100 of 101 posts

Re: GitHub Broken Download URLs

#91

Earlier quoted context omitted.

And then your IPFS pin service has a down time.

The point of IPFS is that as long as a single online host has the content you will be able to fetch it.

Sure, but in case of peer-to-peer downloads it's often the case that not so common stuff have zero seeders.

Re: GitHub Broken Download URLs

#92
> Arch Linux as well for every package downloading tarballs from GitHub. Packages checking out the git source tree are not affected, but they are a minority.

It feels like people are using git wrong.

Re: GitHub Broken Download URLs

#93

> Arch Linux as well for every package downloading tarballs from GitHub. Packages checking out the git source tree are not affected, but they are a minority. It feels like people are using git wrong.

When building distro packages from source, the full revision history of a Git repo is unnecessary. Downloading just the source code of a specific commit or tag with curl is simpler, faster, has fewer dependencies, and is less prone to breakage (well, unless your URLs change under you, as happened here).

Re: GitHub Broken Download URLs

#94
post #93

> Arch Linux as well for every package downloading tarballs from GitHub. Packages checking out the git source tree are not affected, but they are a minority. It feels like people are using git wrong.

When building distro packages from source, the full revision history of a Git repo is unnecessary. Downloading just the source code of a specific commit or tag with curl is simpler, faster, has fewer dependencies, and is less prone to breakage (well, unless your URLs change under you, as happened here).

Git allows checking out only a limited set of changes with the --depth flag:

    git clone --branch v1.0 --depth 1 https://github.com/example/example.git
The parameter is called --branch but it also takes tags.

It's not as fast as fetching a ZIP file, but it gets pretty close.

From my count, this method only requires one dependency (git) whereas the curl + unzip method requires, well, both curl and unzip.

The zip download method (download, decompress, build, compress into package, decompress onto system) is already silly enough, the first decompression part can easily be dropped.

Re: GitHub Broken Download URLs

#95

Earlier quoted context omitted.

His point is that if everyone had their own server, everyone would have better uptime than they currently get using github. The complexity and load of github is the problem.

The problem is that you’re computing the probability of one service going down, when I actually care about the union of the downtime of all of the services that I need (or, equivalently, the intersection of their uptime). If every Arch package hosted its own source code, then even if each one of them has better uptime than GitHub, at least one of them is probably going to go down every single day (assuming their upti…

> There’s a sweet-spot here; GitHub is above the sweet spot, but a lot of “FOSS projects” (the kind that have a single maintainer) are below it.

That's what I'm putting into question, specifically for Github.

Re: GitHub Broken Download URLs

#96
post #82

Earlier quoted context omitted.

> A change in the handling of URL schemes was deployed a couple of days ago This was deployed Thanksgiving week? I realize Github isn't a consumer company, so it doesn't face the same pressures as Amazon, but I'm surprised there wasn't a code freeze so people can have a quiet holiday weekend.

Is everyone at GitHub based in America?

If a good chunk of them are, it's still good to do a code freeze. If %30-90 of your company is on holiday, not a good time to do major things.

Re: GitHub Broken Download URLs

#97

Earlier quoted context omitted.

The problem is that you’re computing the probability of one service going down, when I actually care about the union of the downtime of all of the services that I need (or, equivalently, the intersection of their uptime). If every Arch package hosted its own source code, then even if each one of them has better uptime than GitHub, at least one of them is probably going to go down every single day (assuming their upti…

I remain unconvinced. If github goes down, it goes down for everyones projects. If everyone ran their own servers, only one or two packages would go down at a time. So instead of 100% its like 0.1%. And since they're simpler, as per OPs comment, they'd stay up longer. So a distributed git, as it was originally intended to be used, is more robust than a single point of failure like github. Perhaps githubs value is els…

For a lot of use cases, there really isn’t any important difference between 100% and 0.1%. If any of the source tarballs are unavailable, then I can’t produce a build, and the fact that some of them are available isn’t much consolation. I’m blocked either way.

Especially for an organization like Arch Linux, the solution is really obvious; maintain your own mirror. Debian and Fedora do it, so can they.

Re: GitHub Broken Download URLs

#98
post #93

Earlier quoted context omitted.

When building distro packages from source, the full revision history of a Git repo is unnecessary. Downloading just the source code of a specific commit or tag with curl is simpler, faster, has fewer dependencies, and is less prone to breakage (well, unless your URLs change under you, as happened here).

Git allows checking out only a limited set of changes with the --depth flag: git clone --branch v1.0 --depth 1 https://github.com/example/example.git The parameter is called --branch but it also takes tags. It's not as fast as fetching a ZIP file, but it gets pretty close. From my count, this method only requires one dependency (git) whereas the curl + unzip method requires, well, both curl and unzip. The zip downloa…

> It's not as fast as fetching a ZIP file, but it gets pretty close.

In the context of distro packages (the bug report mentioned OpenBSD and Fedora) you might be building tens of thousands of packages of which thousands are likely to come from GitHub. A small difference becomes greatly magnified.

> From my count, this method only requires one dependency (git) whereas the curl + unzip method requires, well, both curl and unzip.

You’re forgetting that git itself depends on curl.

Re: GitHub Broken Download URLs

#99
post #23

Whether this specific problem is intentional or not, these kinds of problems show the issue with using a single centralized service for distribution of third-party dependencies. But it's just so much more darned convenient than hosting your own Git server! It would be super cool if there was a decentralized alternative to GitHub, that used Git under the hood. Perhaps one would upload their repositories to a node, whi…

I’m amused that the whole open source community depends on what is effectively Microsoft’s closed-source proprietary service.

Re: GitHub Broken Download URLs

#100

Earlier quoted context omitted.

I remain unconvinced. If github goes down, it goes down for everyones projects. If everyone ran their own servers, only one or two packages would go down at a time. So instead of 100% its like 0.1%. And since they're simpler, as per OPs comment, they'd stay up longer. So a distributed git, as it was originally intended to be used, is more robust than a single point of failure like github. Perhaps githubs value is els…

For a lot of use cases, there really isn’t any important difference between 100% and 0.1%. If any of the source tarballs are unavailable, then I can’t produce a build, and the fact that some of them are available isn’t much consolation. I’m blocked either way. Especially for an organization like Arch Linux, the solution is really obvious; maintain your own mirror. Debian and Fedora do it, so can they.

Just to clarify, if 100% of all packages go down, thats much worse than 100% of just your needed packages.

But I agree: mirrors is the key!

Post reply on HN