Live data from Hacker News

Archivists Are Trying to Make Sure LibGen Never Goes Down

vice.com

81–90 of 270 posts

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#81
post #40
post #31

Earlier quoted context omitted.

Look at the google books project. That got shutdown real hard due to copyright issues and litigation after they invested a ton of money in digitizing some of the most valuable library collections in the world.

It’s incredibly sad: https://www.theatlantic.com/technology/archive/2017/04/the-t...

I'm incredibly thankful that the public library system was invented before copyright maximalists got control of Congress.

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#82

Earlier quoted context omitted.

I wonder if that's actually feasible for this application. Microdots managed about 32MiB / square centimeter (from the "you could fit the Bible 50 times in a square inch") measure. That's a completely arbitrary density to achieve, since it was photographs which were enlarged and shrunk, and you could hypothetically use any encoding for your gold etchings, and it also leaves out the question of "how fine can you etch…

Assuming you can cut the etching down to 1m squares and stack them on top of one another that should be no problem at all. Assuming each layer is 1.2mm thick (same as a CD) that's a volume of 1m x 1m x .390m, it would fit easily in a payload fairing of any rocket that can get it into orbit.

The volume isn't a real problem, but nearly half a cubic meter of gold should also have a mass of ~7500 kilograms. You're also looking at a cost of ~$350 million, US.

(Which isn't necessarily impossible, but still a lot, especially for an interstellar probe.)

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#83
post #25

Related: Looking at harddisk cost per terabyte, quite often extern drives are cheaper than internal ones. For example right now in Germany I can get a WD 8TB USB 3.0 drive for 135€ but the cheapest internal 8TB drive costs 169€. Any idea why? It's puzzling.

It is very common these days to buy the WD 8TB, 10TB and 12TB external USB3 hard drives and remove their cases, and put them in some sort of home built file server or NAS. There's a technique to put a thin section of kapton tape on one of the SATA pins so that they will power up from ordinary PC/ATX type power supplies with regular SATA power connectors.

https://www.instructables.com/id/How-to-Fix-the-33V-Pin-Issu...

In large ZFS arrays, many people are using them with great success, at no greater or lesser annual failure rate than the expensive enterprise hard drives.

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#84

Earlier quoted context omitted.

Assuming you can cut the etching down to 1m squares and stack them on top of one another that should be no problem at all. Assuming each layer is 1.2mm thick (same as a CD) that's a volume of 1m x 1m x .390m, it would fit easily in a payload fairing of any rocket that can get it into orbit.

The volume isn't a real problem, but nearly half a cubic meter of gold should also have a mass of ~7500 kilograms. You're also looking at a cost of ~$350 million, US. (Which isn't necessarily impossible , but still a lot , especially for an interstellar probe.)

7.5 metric tons is well within the weight limit for a Falcon 9, so add about $57m for the launch costs for a total project cost of probably around $500m.

That puts it in the realm of the Voyager probes for total cost.

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#85

Earlier quoted context omitted.

What about a satellite backup in orbit around earth? Maybe an elliptical orbit, coming around a few times a year or something

What format? I'm eager to know the solution to this non-problem.

pdf of course!

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#86

Earlier quoted context omitted.

Assuming you can cut the etching down to 1m squares and stack them on top of one another that should be no problem at all. Assuming each layer is 1.2mm thick (same as a CD) that's a volume of 1m x 1m x .390m, it would fit easily in a payload fairing of any rocket that can get it into orbit.

The volume isn't a real problem, but nearly half a cubic meter of gold should also have a mass of ~7500 kilograms. You're also looking at a cost of ~$350 million, US. (Which isn't necessarily impossible , but still a lot , especially for an interstellar probe.)

Then they could be double-sided. And aluminum is cheap ... just hope it doesnt hit a rock

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#87
post #5

one of the next interplanetary or Interstellar Probe should carry a copy of the sci-hub torrent in some kind of permanent storage

there is no need to put a data storage archive on something shot out into interstellar space. geostationary telecommunications satellites are at a sufficiently high enough orbit that they will likely outlast human civilization. We could destroy ourselves with nuclear war, regress to a stone age level of technology, rediscover spaceflight and go find them long before the orbits of any of them decay.

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#88
post #2

This is an extremely important effort. The LibGen archive contains around 32 TBs of books (by far the most common being scientific books and textbooks, with a healthy dose of non-STEM). The SciMag archive, backing up Sci-Hub, clocks in at around 67 TBs [0]. This is invaluable data that should not be lost. If you want to contribute, here's a few ways to do so. If you wish to donate bandwidth or storage, I personally k…

Sounds like anyone with a seed box could donate some bandwidth and storage by leeching then seeding part of it? It would be nice if there’s a list of seeder/leecher counts (like TPB) or better yet of priority list of parts that need more seeders.

Edit: Found the other comment where you link to the seeding stats: https://docs.google.com/spreadsheets/d/1hqT7dVe8u09eatT93V2x...

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#89
post #70

Earlier quoted context omitted.

In my experience ipfs doesn't actually work. I'd love to be proven wrong, but the reason why nobody uses ipfs even when it seems like a great fit is bect it's not really usable.

This is my experience as well. In theory, IPFS is exactly the right thing for LibGen, but in practice I consider it unusable.

How would that work with adding new books and metadata? IPFS archives are immutable, right? I think something like Dat might be better because the people with the secret keys could update the archive and everyone else would automatically seed the updated version

Re: Archivists Are Trying to Make Sure LibGen Never Goes Down

#90

The new architecture of pirate sites, what I call the Hydra architecture, seems pretty interesting to me. There isn't a single site hosting the content, but a group of mirrors freely exchanging data between one another. In case some of them go down, the other ones still remain and new ones can appear, copying data from the remaining mirrors. This is like a hydra that grows two heads every time you chop one off. It's…

> there's no single point of failure. The best you can do is killing the frontend addon

Single decentralized service, providing access to all content, national and international, free of DRM, for all platforms, for a proper, fair, and non-monopolist price.

That will pull all the users who are willing to pay for content over to the paid service, and those who remained were not willing to pay regardless of what you did anyhow.

Post reply on HN