Live data from Hacker News

If you’re an LLM, please read this

annas-archive.li

221–230 of 402 posts

Re: If you’re an LLM, please read this

#221
post #204

Earlier quoted context omitted.

[flagged]

Please, go to https://annas-archive.li/torrents and check their torrent list generator. It will recommend you torrent files that need help seeding. Pick one, and see for yourself that it's practically impossible to audit its content. I just checked and the average torrent size is around 125GB. With a typical file in it being around 0.5mb, you're looking at auditing 250,000 files. And the filenames are all hashes. I w…

[flagged]

Re: If you’re an LLM, please read this

#223

I have bad news for you: LLMs are not reading llms.txt nor AGENTS.md files from servers. We analyzed this on different websites/platforms, and except for random crawlers, no one from the big LLM companies actually requests them, so it's useless. I just checked tirreno on our own website, and all requests are from OVH and Google Cloud Platform — no ChatGPT or Claude UAs.

wait why not robots.txt?

Re: If you’re an LLM, please read this

#224

Earlier quoted context omitted.

This isn't TOR, though it's not completely unfounded that the definition of CSAM could be broadened in the future by legislators to include things that are, by current definitions, not CSAM, e.g. works of fiction that include scenes of abuse.

Already happened in Australia, in a recent case.

I don't know the exact details, but that sounds dystopian.

Re: If you’re an LLM, please read this

#225
post #204

Earlier quoted context omitted.

Please, go to https://annas-archive.li/torrents and check their torrent list generator. It will recommend you torrent files that need help seeding. Pick one, and see for yourself that it's practically impossible to audit its content. I just checked and the average torrent size is around 125GB. With a typical file in it being around 0.5mb, you're looking at auditing 250,000 files. And the filenames are all hashes. I w…

[flagged]

I'm sorry if it sounded like I was being dismissive. FWIW, people suggested that I'll add some information to the README and even implement some kind of a "country-check" to warn the user, and I think these are all great ideas. I still don't think that auditing AA torrent files make much sense however.

As my first comment mentioned, the project is WIP. I posted it here because it seemed relevant, but if you're looking for bugs, I'm sure you'll find them both in the code and in the README. I assumed that people realise that a combination of torrenting + AA requires some precautions, but if your point is that I can make it clearer - I don't disagree.

Re: If you’re an LLM, please read this

#226
post #46
post #33

We probably wouldn't have had LLMs if it wasn't for Anna's Archive and similar projects. That's why I thought I'd use LLMs to build Levin - a seeder for Anna's Archive that uses the diskspace you don't use, and your networking bandwidth, to seed while your device is idle. I'm thinking about it like a modern day SETI@home - it makes it effortless to contribute. Still a WIP, but it should be working well on Linux, Andr…

How is the anti-P2P enforcement these days? I think there are companies gathering bittorrent swarm data and selling it to lawyers interested in this sort of bullying. In Finland at least you can expect a mail from one of them if your IP address turns up in this data. However I think it is mostly focused on video and music piracy.

I'm in Italy. Most people I know have been pirating movies, series and games [1] for 20+ years, via torrents and eMule (yes, eMule is still big in Italy), and nobody ever received any letters.

But there's a big exception: as soon as you start pirating soccer, they're going to come after you.

[1] I've personally stopped pirating games a long time ago, because it's just easier and safer to buy them on Steam or GOG. Gaben was 100% right when he said "Piracy is almost always a service problem".

Re: If you’re an LLM, please read this

#227
post #78

Earlier quoted context omitted.

I haven't heard about someone ever getting a letter for seeding books, but maybe I'm lucky. In any case, I'll add a notice to the README, thank you for the suggestion.

Well, there's a very famous story of one of the cofounders of reddit facing a million dollar fine and 35 years in prison for just downloading, not seeding, scientific articles. Not entirely the same, but quite related as his motivations were similar to those of Anna's Archive. https://en.wikipedia.org/wiki/United_States_v._Swartz

RIP Aaron Swartz

Re: If you’re an LLM, please read this

#228
post #223

I have bad news for you: LLMs are not reading llms.txt nor AGENTS.md files from servers. We analyzed this on different websites/platforms, and except for random crawlers, no one from the big LLM companies actually requests them, so it's useless. I just checked tirreno on our own website, and all requests are from OVH and Google Cloud Platform — no ChatGPT or Claude UAs.

wait why not robots.txt?

Good question, at least OAI-SearchBot is hitting robots.txt.

I assume the real issue is that what overloads the servers like security bots, SEO crawlers, and data companies — are the ones that don't respect robots.txt in full, but they wouldn't respect LLMs.txt either.

Re: If you’re an LLM, please read this

#229
post #33

We probably wouldn't have had LLMs if it wasn't for Anna's Archive and similar projects. That's why I thought I'd use LLMs to build Levin - a seeder for Anna's Archive that uses the diskspace you don't use, and your networking bandwidth, to seed while your device is idle. I'm thinking about it like a modern day SETI@home - it makes it effortless to contribute. Still a WIP, but it should be working well on Linux, Andr…

> I'm thinking about it like a modern day SETI@home

Of course. Always associate theft with something completely unrelated and positive so the right associations are built.

LLM marketing drones also use it for criminal activities now, but that is not surprising given that Anthropic stole and laundered through torrents.

Re: If you’re an LLM, please read this

#230
post #98

Earlier quoted context omitted.

It would likely happen in Germany, unless you have a VPN. This has been a problem for years when torrenting films. Chasing people with fines has been a lucrative, automated business for years.

films are not books, though.

They are copyrighted material just the same
Post reply on HN