I also think it's exceedingly unlikely that any of the top 4 chatbots would choose to load websites this way. Too many risks for a 0.01% adoption even years later.
Serve Markdown to AI Agents with Accept Headers
11–20 of 96 posts
Re: Serve Markdown to AI Agents with Accept Headers
#12Re: Serve Markdown to AI Agents with Accept Headers
#13Maybe tarpit them into reading gigabytes of Markov Chain nonsense, really slowly?
Re: Serve Markdown to AI Agents with Accept Headers
#14Hm, interesting avenue for prompt injection.
How is that different from today where agents just do searches and ingest web pages?
The MD content isn’t intended for human consumption whereas HTML is. So you either have that injection readable to your users, which could be jarring to non-technical readers, or you play the cat-and-mouse game of hoping those pesky crawlers don’t ignore text that’s not human-visible on a rendered page.
Re: Serve Markdown to AI Agents with Accept Headers
#15hoping for this to get mainstream so that I can just view the pages without any ads, js and bloat
> But imagine for a second they did do that. You get the API, all the info is there. > Why do you need AI then? (from this HN comment, worth a read in full: https://news.ycombinator.com/item?id=43679585 )
It's giving https://news.ycombinator.com/item?id=8863#9224
Re: Serve Markdown to AI Agents with Accept Headers
#16Re: Serve Markdown to AI Agents with Accept Headers
#17Earlier quoted context omitted.
How is that different from today where agents just do searches and ingest web pages?
I don’t disagree with you in principle but there is a difference. The MD content isn’t intended for human consumption whereas HTML is. So you either have that injection readable to your users, which could be jarring to non-technical readers, or you play the cat-and-mouse game of hoping those pesky crawlers don’t ignore text that’s not human-visible on a rendered page.
Or everything just disappears behind something like cloudflare or a paywall.
Re: Serve Markdown to AI Agents with Accept Headers
#18A cherry.jpg image/jpeg file is shown as an image by the browser
A logo in svg like https://news.ycombinator.com/y18.svg too
So browsers should show readme.md as text/markdown and clicking on a link inside that file should also redirect to another markdown file, instant wiki
Browsers should implement that asap and we will follow
Re: Serve Markdown to AI Agents with Accept Headers
#19It was already optimized for bots and search engines (which are bots) and it has been used for decades. Why we need to serve in markdown now?
There are also many parts of the HTML, like navs, that are useful for bots and AI and may be removed in the markdown version.
Re: Serve Markdown to AI Agents with Accept Headers
#20What about clean, semantic HTML? It was already optimized for bots and search engines (which are bots) and it has been used for decades. Why we need to serve in markdown now? There are also many parts of the HTML, like navs, that are useful for bots and AI and may be removed in the markdown version.