This seems useful for my site. I don't really want competitors' AI systems use our research data to train their models.
Stay discoverable in search while disallowing AI training
31–40 of 59 posts
Re: Stay discoverable in search while disallowing AI training
#32I wouldn’t trust an AI company to honor this as far as I could throw them
Re: Stay discoverable in search while disallowing AI training
#33I feel like most of these schemes to categorise data as "public but not really" are ultimately doomed to failure. Even if you could trust every AI company in the world to respect these terms, is there anything stopping someone else indexing the data and selling them the information? I know there's copyright law but they're apparently ignoring that anyway.
Ultimately this reminds me of those really early social media profiles (before people understood privacy settings if they even existed) which would say "If you're not my friend you're not allowed to read this page".
If you don't want your content to end up in some database/archive don't publish it for the whole world to see.
Re: Stay discoverable in search while disallowing AI training
#34what weirds me out is the analytics theres no way my index.html page with nothing is getting 10000 hits a day wtf?
They bullshit big time on that, I have caught them not once.
For a site with proven visitors 100,000 per month CF tell me they saved 90,000 over 1,000,000 visitors (rough numbers).
Sure they know large numbers make people feel good.
Re: Stay discoverable in search while disallowing AI training
#35The irony is that search engines are AI companies now. Telling them 'index me for search but don't train your models' is asking them to split a brain that’s already fully merged.
Re: Stay discoverable in search while disallowing AI training
#36What does this really mean though? You can use an LLM to search.
Re: Stay discoverable in search while disallowing AI training
#37there have been a few links here on hn about content protection based on Markov’s chain. It might be interesting for Cloudflare to add damage for the scraper that tries to query the page, and not just blocking them.
Re: Stay discoverable in search while disallowing AI training
#38“Pre-label your most valuable data for us and we promise to not make it too obvious that we’re training on it”
Re: Stay discoverable in search while disallowing AI training
#39"Apple, Google, and Microsoft honor or have committed (in a specified time frame) to honor this setting."
Specified Time Frame ;)
Re: Stay discoverable in search while disallowing AI training
#40"Cloudflare classifies bots by behavior, and a single bot can exhibit more than one behavior." Is that really true CF classifies anyone not using a popular browser with Javascript enabled as a "bot" CF fingerprints www users As an example, look at CF's Permissions-Policy HTTP response header on a site with CF "bot protection", i.e., the "checking your browser" CAPTCHA nonsense (challenges.cloudflare.com). Then look a…
As far as I can tell, after months of fighting being DDoSed by Anthropic and OpenAI across 50+ sites - Cloudflare also allows what it considers "good bots" through all of your bot blocking rules, with no option to turn this off unless you pay them money.
The "good bots" also just happen to be from companies that pay cloudflare a lot of money, I imagine.