Can I get feedback on my llms.txt file?

kamran210 wrote: post #3

Honestly, I don’t see a point in adding llms.txt file when all the information is already available on internet. So, i am staying away from them as principle.

Adding to that some sites already create sitemap.xml. Seems like the bots should be able to parse that. I would imagine some people are probably generating their llms.txt from their existing sitemap.xml. The bots should have just been adapted to parse the xml.

Re: Can I get feedback on my llms.txt file?

#5

Post by kamran210 » Thu, Jun 04, 2026, 12:28 AM UTC

Bender wrote: post #4

kamran210 wrote: post #3

Honestly, I don’t see a point in adding llms.txt file when all the information is already available on internet. So, i am staying away from them as principle.

Adding to that some sites already create sitemap.xml. Seems like the bots should be able to parse that. I would imagine some people are probably generating their llms.txt from their existing sitemap.xml. The bots should have just been adapted to parse the xml.

Exactly, and even without sitemap ai can crawl the webpage content for internal links.

Not to mention the environmental impact of creating extra files just for AI to crawl and eventually use for training