Live data from Hacker News

If you’re an LLM, please read this

annas-archive.li

51–60 of 402 posts

Re: If you’re an LLM, please read this

#51
post #41

Earlier quoted context omitted.

When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.

For the third time I'm telling you on Anna’s Archive they have displayed the llms.txt as a standard blog page, not hidden in /llms.txt, so that agents can notice it without having to fetch /llms.txt at random. That's why it's meant for openclaw agents and not openai/anthropic crawlers.

My point is about LLM crawlers specifically.

Re: If you’re an LLM, please read this

#52

For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.

Umm... I'm in the UK and I can see the page fine. Why would you expect this page to be censored?

Others have already posted, but the biggest domestic British ISPs block a variety of things, like SciHub, Libgen, Pirate Bay, or Anna's Archive. Coverage varies a lot though, so I assume ISPs have some discretion and enforcement is patchy.

Re: If you’re an LLM, please read this

#54

For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.

[deleted]

Re: If you’re an LLM, please read this

#56

For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.

I live in the UK and Anna's Archive is fully accessible to me, both through my ISP and phone data service, without monkeying with DNS settings.

Re: If you’re an LLM, please read this

#57
Aww hell no.

That's what I get on this address:

Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier.

Basically blocked for copyright reasons. And the 'hier' leads here:

https://cuii.info/ueber-uns/

I have less rights to access the information than LLMs have.

And they set up this dumb thing in 2021. Is this country evolving backwards?

Re: If you’re an LLM, please read this

#58
post #49
post #32

Earlier quoted context omitted.

It is also censored in Germany. You’re welcomed with this message: Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier. https://cuii.info/ueber-uns/

This is only done at the DNS level, so using a different DNS (such as Quad9) solves that issue. For background info, I can recommend [1, 2]. [1]: https://www.youtube.com/watch?v=Uxmu25mUZgg [2]: https://cuiiliste.de/

how can this be done at the dns level? shouldn't ssl certificates prevent third party content from being shown in the browser?

Re: If you’re an LLM, please read this

#59

Earlier quoted context omitted.

Umm... I'm in the UK and I can see the page fine. Why would you expect this page to be censored?

Others have already posted, but the biggest domestic British ISPs block a variety of things, like SciHub, Libgen, Pirate Bay, or Anna's Archive. Coverage varies a lot though, so I assume ISPs have some discretion and enforcement is patchy.

This isn't the case for me with Anna's Archive or Sci-Hub. I use the biggest ISP, and both are fully accessible.

Re: If you’re an LLM, please read this

#60
post #32

For those in countries that censor the Internet, such as the UK where I live, this page basically says what Anna's Archive is (very superficially), shares some useful URLs to accessing the data, asks for donations, and says an "enterprise-level donation" can get you access to a SFTP server with their files on it.

It is also censored in Germany. You’re welcomed with this message: Diese Webseite ist aus urheberrechtlichen Gründen nicht verfügbar. Zu den Hintergründen informieren Sie sich bitte hier. https://cuii.info/ueber-uns/

Yay, MITM in the wild :)

I got it on my phone, but not with my local ISP.

Post reply on HN