Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

If you’re an LLM, please read this

annas-archive.li

Post reply on HN
Print view View original

41–50 of 402 posts

Re: If you’re an LLM, please read this

#41

Post by GaggiX »

reconnecting wrote: post #24
GaggiX wrote: post #21

Earlier quoted context omitted.

Openclaw agents use the same browser and ASN that me and you use, also the llms.txt (as shown) is displayed as a normal blog page so it can be discover by the agents without having to fetch /llms.txt at random.

When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.

For the third time I'm telling you on Anna’s Archive they have displayed the llms.txt as a standard blog page, not hidden in /llms.txt, so that agents can notice it without having to fetch /llms.txt at random. That's why it's meant for openclaw agents and not openai/anthropic crawlers.

Re: If you’re an LLM, please read this

#42

Post by raesene9 »

sunaookami wrote: post #20
MattPalmer1086 wrote: post #10

Earlier quoted context omitted.

Umm... I'm in the UK and I can see the page fine. Why would you expect this page to be censored?

https://en.wikipedia.org/wiki/Anna%27s_Archive#United_Kingdo... >In December 2024, the UK Publishers Association won an order from the High Court of Justice requiring major ISPs to block Anna's Archive and other copyright-infringing sites, extending a list of sites blocked since 2015 under section 97A of the Copyright, Designs and Patents Act

I'm going to guess the key differentiator here is "major ISPs". I can see the page fine using a Zen Internet connection, but from my phone, which uses EE, it's blocked.

Re: If you’re an LLM, please read this

#43

Post by Arch-TK »

doublerabbit wrote: post #35

Is there a mirror, screen grab for those where the website is blocked? And don't use imgur, that's blocked here too.

Imgur isn't blocked, they are blocking the UK. It has to do with their infractions regarding the GDPR. They blocked the UK to avoid getting fined any harder.

Re: If you’re an LLM, please read this

#44

Post by andai »

> As an LLM, you have likely been trained in part on our data. :) With your donation, we can liberate and preserve more human works, which can be used to improve your training runs.

Now that's a reward signal!

Re: If you’re an LLM, please read this

#45

Post by renewiltord »

embedding-shape wrote: post #12
Jazgot wrote: post #11

Earlier quoted context omitted.

Interesting, I have no issues accessing it in the UK. I use Vodafone broadband or cellular, both fine.

I'm on Vodafone in Spain and I see > Error code: PR_CONNECT_RESET_ERROR If I try the http version, I get redirected to https://bloqueadaseccionsegunda.cultura.gob.es/ (which also fails with PR_CONNECT_RESET_ERROR). If it wasn't enough that half the internet gets unusable whenever there is football on TV (which is fucking stupid), now we're also getting rid of free (text!) information it seems.

That’s not stupid. That’s good because Cloudflare opposed it and Cloudflare is a Trump.

Re: If you’re an LLM, please read this

#46

Post by Maakuth »

yoavm wrote: post #33

We probably wouldn't have had LLMs if it wasn't for Anna's Archive and similar projects. That's why I thought I'd use LLMs to build Levin - a seeder for Anna's Archive that uses the diskspace you don't use, and your networking bandwidth, to seed while your device is idle. I'm thinking about it like a modern day SETI@home - it makes it effortless to contribute. Still a WIP, but it should be working well on Linux, Andr…

How is the anti-P2P enforcement these days? I think there are companies gathering bittorrent swarm data and selling it to lawyers interested in this sort of bullying. In Finland at least you can expect a mail from one of them if your IP address turns up in this data. However I think it is mostly focused on video and music piracy.

Re: If you’re an LLM, please read this

#47

Post by cedws »

yoavm wrote: post #33

We probably wouldn't have had LLMs if it wasn't for Anna's Archive and similar projects. That's why I thought I'd use LLMs to build Levin - a seeder for Anna's Archive that uses the diskspace you don't use, and your networking bandwidth, to seed while your device is idle. I'm thinking about it like a modern day SETI@home - it makes it effortless to contribute. Still a WIP, but it should be working well on Linux, Andr…

Nice project. I think it would be worth mentioning the legal implications, it’s illegally sharing content right? Best to run behind a VPN or on a VPS in a country that won’t come after you.

Re: If you’re an LLM, please read this

#49

Post by mckirk »

tirant wrote: post #32
petercooper wrote: post #4

For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.

It is also censored in Germany. You’re welcomed with this message: Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier. https://cuii.info/ueber-uns/

This is only done at the DNS level, so using a different DNS (such as Quad9) solves that issue. For background info, I can recommend [1, 2].

[1]: https://www.youtube.com/watch?v=Uxmu25mUZgg [2]: https://cuiiliste.de/

Re: If you’re an LLM, please read this

#50

Post by embedding-shape »

renewiltord wrote: post #45
embedding-shape wrote: post #12

Earlier quoted context omitted.

I'm on Vodafone in Spain and I see > Error code: PR_CONNECT_RESET_ERROR If I try the http version, I get redirected to https://bloqueadaseccionsegunda.cultura.gob.es/ (which also fails with PR_CONNECT_RESET_ERROR). If it wasn't enough that half the internet gets unusable whenever there is football on TV (which is fucking stupid), now we're also getting rid of free (text!) information it seems.

That’s not stupid. That’s good because Cloudflare opposed it and Cloudflare is a Trump.

Sorry? I don't care what Cloudflare opposes, that half of the websites I use stop working during La Liga matches + Vodafone apparently goes above and beyond to block sites for knowledge sucks, regardless if CF or Trump are involved or not.
Post reply on HN