Why would anyone choose to anonymously and freely provide content to LLMs? Actually the only use case for that is deliberately seeding misinformation. Which is likely already happening and will soon be the majority of the content accessible to LLMs regardless of what blocking legitimate content providers choose to use.
Blocking LLMs from your website cuts you off from next-generation search
31–40 of 82 posts
Re: Blocking LLMs from your website cuts you off from next-generation search
#32Re: Blocking LLMs from your website cuts you off from next-generation search
#33Re: Blocking LLMs from your website cuts you off from next-generation search
#34> how many of you wouldn’t hook up your website to Google? If there was a paid-only search engine with dubious ethics practices that was overwhelming my site with traffic in order resell search trained off of (among other things) my personally generated content, I would absolute block it. LLMs are not search engines, and I'm not gaining any followers or customers in any meaningful way because an LLM indexes my site.…
Re: Blocking LLMs from your website cuts you off from next-generation search
#35Re: Blocking LLMs from your website cuts you off from next-generation search
#36Like everything else on the web, LLMs are going to eventually be ruined by marketing teams trying to get them to say "Pepsi" instead of "Coke."
Re: Blocking LLMs from your website cuts you off from next-generation search
#37Re: Blocking LLMs from your website cuts you off from next-generation search
#38You write content so that you get paid, usually through ads and clicks. If people aren't seeing your content because am LLM has consumed it and is regurgitating it and taking your ad clicks, then there's no benefit for you only for the LLM. You're doing the work of Sam Altman and helping him attain his multibillionaire status and you get nothing in return.
Re: Blocking LLMs from your website cuts you off from next-generation search
#39> how many of you wouldn’t hook up your website to Google? If there was a paid-only search engine with dubious ethics practices that was overwhelming my site with traffic in order resell search trained off of (among other things) my personally generated content, I would absolute block it. LLMs are not search engines, and I'm not gaining any followers or customers in any meaningful way because an LLM indexes my site.…
Friends of mine run a service company, and they already see a significant number of customers reach out because they found them using ChatGPT (et al), not Google. By significant I mean ~20% or so.
Also, for e-commerce, Deep Research from OpenAI, is way better in doing product recommendations than Google. That's my goto place to find most stuff novadays (e.g. I purchased dancing shoes, pants, air cleaners, an air conditioner, supplements and a ton of other things using the recommendations of DR - no search engine comes even close to it)
Re: Blocking LLMs from your website cuts you off from next-generation search
#40The fact LLM companies constantly keep getting dinged for ignoring every barrier we throw up to stop their scraping short of something like Anubis shows what their real goal is: theft, monopolization, and reality authoring.