Why was this flagged? A difference in opinion is no excuse for censorship.
His disdain for content creators (in the very first paragraph) is not an opinion. I'm showing my disdain with a flag.
Blocking LLMs from your website cuts you off from next-generation search
51–60 of 82 posts
Re: Blocking LLMs from your website cuts you off from next-generation search
#52Screw this. I didn't put effort into writing many paragraphs of content for my own websites just so it could be summarized by an LLM. I wrote it because I wanted other human beings to read it.
This is just yet another person running an AI company telling me why I should provide free data and labor to the LLMs that power their company. These AI companies are acting as middlemen between the end-user and the content creator; its the latest iteration of an age-old business model which works-out great for the middlemen. Meanwhile, people on either side are taken advantage of.
If the "next-generation" of search is accessed mostly through an LLM, then there's no incentive to participate in it unless you're directly selling a product or service... and then you have to hope and pray the LLM doesn't lie and misrepresent you. Otherwise, if you're making a website to share information or show off your own work, there's zero incentive to participate.
If AI companies want to pay me cold hard cash every time they query my site, then we can negotiate.
Re: Blocking LLMs from your website cuts you off from next-generation search
#53This post gets the reason why people are cutting off LLMs exactly backwards and consequently completely fails to address the core issue. The whole reason people are blocking LLMs is precisely that they believe it kills the flow of readers to your content. The LLMs present your ideas and content, maybe with super-tiny attribution that nobody notices or uses [1], maybe with no attribution at all, and you get nothing. P…
Why would removing your content from LLM training data cause people to go and seek it out directly from you?
Would removing your website from google search results cause people to go directly to your website?
Re: Blocking LLMs from your website cuts you off from next-generation search
#54Earlier quoted context omitted.
Why do tech bros assume that every site is selling a product? There are blogs, personal web sites, communities, and open-source projects out there.
If there's no product, and it's free, why would one care about it appearing in the output of an LLM? If it's so secret that it shouldn't, then perhaps it should be behind some auth anyway.
Because writing is, in many senses, exposing yourself, and at the very least you want the recognition for it (even if only in the form of a visit to the website, and maybe the interactions that can follow)? Maybe you want at least the prestige that comes with writing good content that took a lot of time to create. Maybe because you want to participate in a community with your stuff. Maybe other million reasons.
I know that medium, substack and the other "publication" platforms (like LinkedIn) are trying to commodify even the act of writing into purely a form or marketing (either for a product, or for your personal brand), but not everyone gave up just yet.
Re: Blocking LLMs from your website cuts you off from next-generation search
#55Incredibly simplistic. I’m having a hard time believing a real person wrote this, read it over and decided they had made anything resembling a point. How about the fact that Google (ideally) sends users to you rather than sharing your work unattributed?
Heck, Google mostly shows "AI Summaries" and ads -- you'd be lucky to get traffic from 'em now!
Re: Blocking LLMs from your website cuts you off from next-generation search
#56I'm surprised I don't see any comments here to this effect yet: isn't this just AMP 2.0? Website authors don't want their content scraped and rehosted by a 3rd party, even when that 3rd party claims it's for their own benefit. We have a whole kerfuffle about this nearly a decade ago. The arguments for both sides don't appear to have changed.
Re: Blocking LLMs from your website cuts you off from next-generation search
#57Earlier quoted context omitted.
If there's no product, and it's free, why would one care about it appearing in the output of an LLM? If it's so secret that it shouldn't, then perhaps it should be behind some auth anyway.
Because writing is, in many senses, exposing yourself, and at the very least you want the recognition for it (even if only in the form of a visit to the website, and maybe the interactions that can follow)? Maybe you want at least the prestige that comes with writing good content that took a lot of time to create. Maybe because you want to participate in a community with your stuff. Maybe other million reasons. I kno…
Agreed, and we can argue semantics, but many folks would consider the content in that case a product.
Re: Blocking LLMs from your website cuts you off from next-generation search
#58This post gets the reason why people are cutting off LLMs exactly backwards and consequently completely fails to address the core issue. The whole reason people are blocking LLMs is precisely that they believe it kills the flow of readers to your content. The LLMs present your ideas and content, maybe with super-tiny attribution that nobody notices or uses [1], maybe with no attribution at all, and you get nothing. P…
Why would removing your content from LLM training data cause people to go and seek it out directly from you? Would removing your website from google search results cause people to go directly to your website?
This seems like a weird comparison - Google’s explicit purpose is to direct people to your site. An LLMs purpose is not.
Re: Blocking LLMs from your website cuts you off from next-generation search
#59Earlier quoted context omitted.
Why do tech bros assume that every site is selling a product? There are blogs, personal web sites, communities, and open-source projects out there.
If there's no product, and it's free, why would one care about it appearing in the output of an LLM? If it's so secret that it shouldn't, then perhaps it should be behind some auth anyway.
Not everything everyone does is for a profit motive. I'm not trying to sell you anything ; myself included, when you visit my site. It's just reading material.
Re: Blocking LLMs from your website cuts you off from next-generation search
#60Why was this flagged? A difference in opinion is no excuse for censorship.
His disdain for content creators (in the very first paragraph) is not an opinion. I'm showing my disdain with a flag.
Not my reading of what he said. After all, he himself is a 'content creator'. In any case, he should not be censored.