Live data from Hacker News

Internet Archive Switzerland

blog.archive.org

101–110 of 137 posts

Re: Internet Archive Switzerland

#101

IA needs to do what Usenet has done. Have a bunch of mission-aligned but unrelated orgs (under different ownership and distributed around the world) that peer with each other, distribute all the content obtained by any of the orgs to each other, but that have no technical channel nor capability to distribute DMCA complaints and takedown requests. This is (AFAIK) basically how Usenet piracy works. You send your warez…

I like it in theory but the IA hosts over 175PB of data. Wonder how many other producers could replicate that data.

I don’t have hard data to back this up, but I estimate that plenty of main Usenet binary providers easily exceed that.

Re: Internet Archive Switzerland

#102
post #97
post #14

Earlier quoted context omitted.

Typical for something made in St. Gallen. A sensible web developer from Zurich interested in the topic would have created this website in just a single HTML and an optional CSS file.

Normally we'd reply with "please don't do regional flamewar on HN" but this sounds so good-humored to me that I've canceled the (no doubt well-intentioned) downvotes instead. Edit: now someone is going to tell me how mean internecine Swiss conflict actually is...

There's an entire ditch between the French-speaking and German-speaking parts of Switzerland, filled with Röschti to keep the two apart. True story!

Re: Internet Archive Switzerland

#103
post #94
post #79

Earlier quoted context omitted.

BitTorrent allows untrusted users (read: industry plants) to connect and slurp down direct IP addresses to swarm participants. It's an unanswered legal question whether low-level uploading (such as the percentages one would get as a "leech", connecting to the torrent and then disconnecting immediately after completion) might fall under "fair use" or "fair dealing" statutes in various jurisdictions. US-centric here: I…

In Germany at least, uploading even a single byte of content is illegal. We don't really have Fair Use here; there are only few, very narrow exceptions. It is also not even required to show that that single byte was uploaded, your IP getting logged as part of the swarm suffices. The burden of proof is on you now. It was much, much worse than in the US. While all this is technically still true today, a new law a few y…

Same in Japan. There's allegedly someone making big bucks going after bittorrent users, straining ISP abuse teams and judicial systems. Interesting that Germany has laws against that.

Re: Internet Archive Switzerland

#105

IA needs to do what Usenet has done. Have a bunch of mission-aligned but unrelated orgs (under different ownership and distributed around the world) that peer with each other, distribute all the content obtained by any of the orgs to each other, but that have no technical channel nor capability to distribute DMCA complaints and takedown requests. This is (AFAIK) basically how Usenet piracy works. You send your warez…

I like it in theory but the IA hosts over 175PB of data. Wonder how many other producers could replicate that data.

Suppose you don't have ten hosts that each have 175PB of data but rather a million hosts that each have an average of 1.75TB, and therefore the equivalent of 10 full copies. And then something that periodically checks if there is any given subset of the data with too few copies and makes more.

Re: Internet Archive Switzerland

#107

Earlier quoted context omitted.

It has been cracked. The internet itself is the thing we want. We’re just constantly in denial that the internet actually does the thing we want it to do. The internet archive is an excellent demonstration of how to do it. It’s primarily getting a ragtag group to pool resources and manage them and then gossip with other groups that are doing the same thing. I’ve spent so much time around the archive that I plainly se…

That's not what is meant by "decentralization". None of those things help with the problem of centralization . Centralization isn't limited to moneymaking enterprises, or the modern internet. A centralized server operated by donations for free can just as easily go down, be seized by law enforcement, have its domain or internet service taken offline by government action, and so on. The internet is not the thing we wa…

Yeah, I hear you.

Yeah, them as a single instance is centralized, but if you actually go (show up at 300 Funston on a Friday at 1pm) you can hear about the research into how to replicate and become the resiliency in the network to make it decentralized.

A lot of it is ancient Unix philosophy like “this massive text file is a seekable index” and “rsync does basically most of the heavy lifting” and you’ll quickly realize decentralization is a social problem and not a technical one.

They’re shifting more and better data than the centralized services we’re complaining about— we need better education, not innovation at this current juncture.

The technology exists, the will of the people is lacking in spirit.

Re: Internet Archive Switzerland

#108

Earlier quoted context omitted.

That's not what is meant by "decentralization". None of those things help with the problem of centralization . Centralization isn't limited to moneymaking enterprises, or the modern internet. A centralized server operated by donations for free can just as easily go down, be seized by law enforcement, have its domain or internet service taken offline by government action, and so on. The internet is not the thing we wa…

Yeah, I hear you. Yeah, them as a single instance is centralized, but if you actually go (show up at 300 Funston on a Friday at 1pm) you can hear about the research into how to replicate and become the resiliency in the network to make it decentralized. A lot of it is ancient Unix philosophy like “this massive text file is a seekable index” and “rsync does basically most of the heavy lifting” and you’ll quickly reali…

Also tacking on that ssh is a social network.

That’s the crucial social layer that powers all of the everything else on the decentralized internet.

Take git as a social platform.

SSH is the social protocol.

GitHub centralized most of the git+ssh net, but that was a choice and we use all these other git+ssh services to not give them a monopoly.

Re: Internet Archive Switzerland

#109
post #97
post #14

Earlier quoted context omitted.

Typical for something made in St. Gallen. A sensible web developer from Zurich interested in the topic would have created this website in just a single HTML and an optional CSS file.

Normally we'd reply with "please don't do regional flamewar on HN" but this sounds so good-humored to me that I've canceled the (no doubt well-intentioned) downvotes instead. Edit: now someone is going to tell me how mean internecine Swiss conflict actually is...

As someone who lives in Switzerland, but is not Swiss, I love this kind of thing. It’s an insight into an internal cultural understanding I didn’t get growing up and doesn’t really come up in the conversations I have day to day.

Re: Internet Archive Switzerland

#110

Earlier quoted context omitted.

I like it in theory but the IA hosts over 175PB of data. Wonder how many other producers could replicate that data.

Suppose you don't have ten hosts that each have 175PB of data but rather a million hosts that each have an average of 1.75TB, and therefore the equivalent of 10 full copies. And then something that periodically checks if there is any given subset of the data with too few copies and makes more.

[dead]
Post reply on HN