Live data from Hacker News

How to become a pirate archivist

annas-blog.org

61–70 of 103 posts

Re: How to become a pirate archivist

#61
post #39
post #34

As the founder of emuparadise some 22 years ago, I can relate. I got into retrogames because I never got to play those games growing up in India. I thought, well let me archive these games and make them available for everyone else to play. It was wildly successful. At it's zenith EmuParadise was ranked 700 or so as per Alexa on the entire internet. We're talking millions of visitors per day and thousands of active us…

I just want to say thank you for creating emuparadise. As a kid (~2005) searching for ROMs online, I remember finding a ton of ad-ridden fake sites, endless demands for "voting" on link aggregator sites, and malware downloads. Emuparadise was like a breath of fresh air compared to those sites, and it basically instantly became my favorite ROM site. While not perfect, it actually had all the games I was looking for, a…

Oh yes, I always tried to keep it friendly towards our users. There were too many sites out there that just kept you going in loops forever to get to whatever you wanted. Thanks for noticing that :)

Our bittorrent tracker was very short lived. It did well and had some pretty good sets on it! But in 2010 when bittorrent was getting a really bad name right after The Pirate Bay case it was easy to get torrent trackers shut down.

One day I got a downtime alert, I think it was mid-2010. I checked the site, gone. The server, unresponsive. I got in touch with the host. He said he'll check with the data center. After a while he got back to me and said: "German police came in and seized your servers." There had been no notice, no warning, no nothing. Just boom, and gone. I asked him: "How can they do this? What do we do?". He said: "Nothing, they just come and take whatever they want every now and then."

I hired a lawyer in Frankfurt to go and check on the case. He said that they had closed the case with no further process because the person in question was unknown. And he ended that email with: "But Nintendo may try something else".

Until that moment, I had no idea that Nintendo was behind the server seizure. I was relieved that the case was closed. Anyway, I still went ahead and resurrected the site sans bittorrent tracker. YOLO and all that.

For the next 8 years, we never really had much trouble after that except the usual DMCA takedown notice here and there and a threatening legal letter sometimes. But pressure kept piling up. I did consider myself small and unimportant fish to fry (compared to say, The Pirate Bay or even current gen videogame piracy websites) but that didn't stop them from going after LoveROMs.

There was always the chance that one day they would just catch me at an airport or immigration (like the kickasstorrents dude) or something and that would be it. Or the police would just knock at my door. I mean, they would have to know who I was provably but I don't think it would be that hard for a government agency. It was just a matter of time that the powers that be would need to lobby the government to get at me.

I didn't want to live my life like that any more.

Re: How to become a pirate archivist

#62
post #2

«That secrecy, however, comes with a psychological cost. Most people love being recognized for the work that they do, and yet you cannot take any credit for this in real life.» Feels like the anonymous torrent seeder who keeps seeding a file for years just for the sake of keeping it alive. It's not easy, but some people seem to be able to derive full pleasure from accomplishing the task itself, whether recognition ha…

One of my proudest achievements-that-dont-count-for-much-outside-of-internet-nerd-innercircles is maintaining a seed ratio of >7 over a a decade and a half in a world where most folks are happy with their seed ratio if 0.1

I seed until 2.0 or i move the files to their proper locations, whichever comes last. I don't set time limits or anything. I have the unadulterated bandwidth to do this, even if it takes a year or more. My main seedbox actually is on the fritz, and i have a small feeling of guilt that if i am too lazy to fix the box that has the .torrent files, that dozens of people will miss out.

I hand-ripped and released the netflix wii disc once upon a time, and my seed ratio on that was astronomically high.

Re: How to become a pirate archivist

#63
post #36

As an active hoarder I think there is problem with "6. Distribution: Packaging it up in torrents, announcing it somewhere, getting people to spread it.". I miss a p2p application with torrent packaging and Kademlia like per-file advertising and discovery, where I could point it to my hefty NAS directory of random things and they could be wired to released torrents. This way we could make torrents live much longer, ev…

The "v2" torrent file format allows most of this. Some clients have support already. All you'd have to do is make a torrent of your whole hard drive and then seed that. You don't need to publish the torrent anywhere. If anyone else in the world is downloading any other torrent that happens to contain a file you have, they will end up connecting to your machine to download it.

Hm, is there a security concern here?

Someone could use this to

A) Remotely check the presence of any specific file on your machine.

B) Exfiltrate the contents of any file they know the hash of (or possibly more specifically, the hash of each piece? I don't know the protocol details).

Fine if you have a dedicated "I expect the contents to be public" drive or directory, but not something I'd want to do on my OS drive.

Re: How to become a pirate archivist

#64
post #47

I keep feeling we shouldn't accept the term "piracy" anymore. The problem, the big problem is on the so-called "legal" side, and the purpose of this system is not about retrieving authors anymore, is about some big economic groups hoarding goods (and power by doing that). But that's heavily against the common interest. I met quite a few years ago with a member of my country's senate with a solid proposition to end th…

The "DNA" of pirate-ish-ness is baked into the US cultural zeitgeist since the 1860s. Freebooters, filibuster, the US excursions into Central America in the 1850s, and the overall Dutch influence on our language and culture still captures some part of us, whether we want it to or not. We're adverse to pirates, even though pirates are universally bad. Unless it's Jack Sparrow. I guess.

Re: How to become a pirate archivist

#65

I'm curious how Sci-hub's approach compares to the What.cd/Redacted approach. IIUC Sci-hub has scooped up science docs through a good enough UX that it was able to leverage the goodwill of science folks to upload docs (plus whatever other methods it has used to scoop up docs), and it uses a public blitzkrieg-style distribution mechanism. I.e., I guess if one had a big enough harddrive and a fast enough internet conne…

> Was any data lost between the two services?

Yes, absolutely, a lot.

Even though some people have automated their setup very well and have been downloading (and uploading on the newer trackers) a lot, it's just a giant amount of content, it's unlikely for any one person to have it all, and coordination was very limited back then.

The birthday release of the torrent db of what.cd includes 2.6m torrents in 1.2m groups (aka individual releases), in total weighing in at 588TB (or 421TB is you discard mp3, but there was content that hadn't been available in FLAC). That's doable on an SWE salary today if you're dedicated, but what.cd was shut down in 2016, and you'd still need to deal with the ratio system during collection.

Re: How to become a pirate archivist

#66
post #63

Earlier quoted context omitted.

The "v2" torrent file format allows most of this. Some clients have support already. All you'd have to do is make a torrent of your whole hard drive and then seed that. You don't need to publish the torrent anywhere. If anyone else in the world is downloading any other torrent that happens to contain a file you have, they will end up connecting to your machine to download it.

Hm, is there a security concern here? Someone could use this to A) Remotely check the presence of any specific file on your machine. B) Exfiltrate the contents of any file they know the hash of (or possibly more specifically, the hash of each piece? I don't know the protocol details). Fine if you have a dedicated "I expect the contents to be public" drive or directory, but not something I'd want to do on my OS drive.

I have seen people obviously sharing their entire hard drive on P2P platforms, and it's usually been someone's C drive and a massive security issue. I don't think some clients do enough to make it clear to people that they need to be careful not to share more than they intend to or should.

Re: How to become a pirate archivist

#67

I'm curious how Sci-hub's approach compares to the What.cd/Redacted approach. IIUC Sci-hub has scooped up science docs through a good enough UX that it was able to leverage the goodwill of science folks to upload docs (plus whatever other methods it has used to scoop up docs), and it uses a public blitzkrieg-style distribution mechanism. I.e., I guess if one had a big enough harddrive and a fast enough internet conne…

Redacted's ratio economy is fucked. There's groups of people using high speed seedboxes that grab every new upload to build up ratio in a normal way, if you can call it that.

Everyone else is left with scraps, trickling data out to whoever comes later. Or maybe you get lucky and you're the lone seeder, you get a 1:1 copy. You just better hope that was on a 24-Bit FLAC release, given how big they can get.

There's many many threads on https://old.reddit.com/r/trackers about REDs economy problems. OPS has a bonus point system and suffers less, but has worse content than RED. My opinion only though

rutracker is all about putting content out there. A lot of stuff is mislabelled or lower quality, less retention, identified wrong, seeded slowly. But you can sure find a lot of oddities there.

> was any data lost

yes, absolutely. I've hundreds of albums not on RED, and I can't bother to reupload them. it's a total waste of time when you know they're unseeded in a week if not for me hanging on.

time better spent finding new music and sharing everything on soulseek instead.

Re: How to become a pirate archivist

#68
post #26

Earlier quoted context omitted.

Sci-Hub was interesting because until 2021, it could automatically add any article not in its database by querying proxy servers set up at universities that actually subscribed to the journals, which would then download the PDF from the journal’s website and forward it to Sci-Hub. (This was the approach most academics took in the pre-Sci-Hub days; they’d email friends at other universities and ask them if they had ac…

The Pirate Bay has never hosted any content; yet many, many cases have been decided against them. Why would that work for sci-hub?

I didn’t say that all countries would deem Sci-Hub legal, just that some might. Indeed, The Pirate Bay is perfectly legal in several countries.

Re: How to become a pirate archivist

#69
post #30

I'm curious how Sci-hub's approach compares to the What.cd/Redacted approach. IIUC Sci-hub has scooped up science docs through a good enough UX that it was able to leverage the goodwill of science folks to upload docs (plus whatever other methods it has used to scoop up docs), and it uses a public blitzkrieg-style distribution mechanism. I.e., I guess if one had a big enough harddrive and a fast enough internet conne…

Bounty systems are a pretty common way to get insane upload ratios so that you can archive.

>insane upload ratios

not with most RED bounties you can fill. if you only sort by biggest bounties, you get albums that realistically can't be filled, or that would require serious money and effort to find.. rare asia specific releeases and stuff.

you can do specific requests if you have accounts for streaming platforms but nobody makes bounty requests for those

Re: How to become a pirate archivist

#70
post #63

Earlier quoted context omitted.

Hm, is there a security concern here? Someone could use this to A) Remotely check the presence of any specific file on your machine. B) Exfiltrate the contents of any file they know the hash of (or possibly more specifically, the hash of each piece? I don't know the protocol details). Fine if you have a dedicated "I expect the contents to be public" drive or directory, but not something I'd want to do on my OS drive.

I have seen people obviously sharing their entire hard drive on P2P platforms, and it's usually been someone's C drive and a massive security issue. I don't think some clients do enough to make it clear to people that they need to be careful not to share more than they intend to or should.

On modern windows, ideally there are no sensitive files accessible to a user program, because everything should be in the secret store/protectedstorage.

Obviously a lot of programs still store cached session keys and passwords in plaintext somewhere in your user directory though...

Post reply on HN