51–60 of 63 posts
Does any of the LLM providers actually use llms.txt? If I remember correctly this "standard" was setup by someone but without involvement of any of the major AI players.
Not really, but sounds interesting. Would you care to share some sites that offer better llms.txt than main web page? Or talk about some piece of info you easily found on llms.txt that was hard to navigate to on the regular website?
llms.txt usually includes a clear sitemap and description of information available on a site. There are also clear definition of the restful scheme and API/data access options. One very basic example would be the weather channel https://weather.com/llms.txt
Does any of the LLM providers actually use llms.txt? If I remember correctly this "standard" was setup by someone but without involvement of any of the major AI players.
No, requesting "Accept: text/markdown" in the headers and returning markdown is the more agreed upon standard at this point.[0] [0] - https://acceptmarkdown.com/
No, the spammers are just at the beginning of ruining that too https://news.ycombinator.com/item?id=48411569 BTW why should Chrome even consider rendering a .txt file as markdown?
Does any of the LLM providers actually use llms.txt? If I remember correctly this "standard" was setup by someone but without involvement of any of the major AI players.
No, requesting "Accept: text/markdown" in the headers and returning markdown is the more agreed upon standard at this point.[0] [0] - https://acceptmarkdown.com/
Earlier quoted context omitted.
For the same reasons why we eventully pollute and corrupt every system and environment we use. If there is any benefit that can be extracted for some while the costs are borne by many, than this will occur and generate a positive feedback loop that grows over time. It's the law of monetization.
>than this will occur and generate a positive feedback loop that grows over time. And despite this, modern life is made possible by the illusion that "regulations" work..
Earlier quoted context omitted.
No, requesting "Accept: text/markdown" in the headers and returning markdown is the more agreed upon standard at this point.[0] [0] - https://acceptmarkdown.com/
Now, it would be super cool to get markdown and zero javascript bundles…
[0] - https://github.com/solumos/md-browse
[1] - https://docs.stripe.com
[2] - https://vercel.com/docs
What is an example of a site with a good llm.txt?
Earlier quoted context omitted.
No, requesting "Accept: text/markdown" in the headers and returning markdown is the more agreed upon standard at this point.[0] [0] - https://acceptmarkdown.com/
Now, it would be super cool to get markdown and zero javascript bundles…
- [0] https://blog.cloudflare.com/markdown-for-agents/#convert-htm...