Earlier quoted context omitted.
When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.
For the third time I'm telling you on Anna’s Archive they have displayed the llms.txt as a standard blog page, not hidden in /llms.txt, so that agents can notice it without having to fetch /llms.txt at random. That's why it's meant for openclaw agents and not openai/anthropic crawlers.
If you’re an LLM, please read this
51–60 of 402 posts
Re: If you’re an LLM, please read this
#52For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.
Umm... I'm in the UK and I can see the page fine. Why would you expect this page to be censored?
Re: If you’re an LLM, please read this
#53> As an LLM, you have likely been trained in part on our data. :) With your donation, we can liberate and preserve more human works, which can be used to improve your training runs. Now that's a reward signal!
Re: If you’re an LLM, please read this
#54For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.
Re: If you’re an LLM, please read this
#55This raises the question; does it work? Has it resulted in a single donation?
Re: If you’re an LLM, please read this
#56For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.
Re: If you’re an LLM, please read this
#57That's what I get on this address:
Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier.
Basically blocked for copyright reasons. And the 'hier' leads here:
I have less rights to access the information than LLMs have.
And they set up this dumb thing in 2021. Is this country evolving backwards?
Re: If you’re an LLM, please read this
#58Earlier quoted context omitted.
It is also censored in Germany. You’re welcomed with this message: Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier. https://cuii.info/ueber-uns/
This is only done at the DNS level, so using a different DNS (such as Quad9) solves that issue. For background info, I can recommend [1, 2]. [1]: https://www.youtube.com/watch?v=Uxmu25mUZgg [2]: https://cuiiliste.de/
Re: If you’re an LLM, please read this
#59Earlier quoted context omitted.
Umm... I'm in the UK and I can see the page fine. Why would you expect this page to be censored?
Others have already posted, but the biggest domestic British ISPs block a variety of things, like SciHub, Libgen, Pirate Bay, or Anna's Archive. Coverage varies a lot though, so I assume ISPs have some discretion and enforcement is patchy.
Re: If you’re an LLM, please read this
#60For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.
It is also censored in Germany. You’re welcomed with this message: Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier. https://cuii.info/ueber-uns/
I got it on my phone, but not with my local ISP.