[dead]
Stay discoverable in search while disallowing AI training
21–30 of 59 posts
Re: Stay discoverable in search while disallowing AI training
#22A bit too late honestly (?). With so many people who have shifted over to reading AI summaries as a primary search response, those with AI-enabled sites will win by attrition. There is no going back from this. And the internet is a relatively new phenomenon. Recklessly, blindly applying ads to pages in hopes of generating revenue is a very silly thing to do. Technology with ad blockers and now AI summaries has taken…
All this attitude does is tear down the only viable income source for independent publishers and demonizes them for trying to make money, while everyone let's huge corporations off the hook for it because "well that's just what they do"
Independent publishers can't afford to run an ad network.
You aren't independent. You work for the BigTech company that serves ads on your site.
Re: Stay discoverable in search while disallowing AI training
#23If this admin is serious about AI growth they’d make anti-scrapping illegal.
Re: Stay discoverable in search while disallowing AI training
#24"Cloudflare classifies bots by behavior, and a single bot can exhibit more than one behavior." Is that really true CF classifies anyone not using a popular browser with Javascript enabled as a "bot" CF fingerprints www users As an example, look at CF's Permissions-Policy HTTP response header on a site with CF "bot protection", i.e., the "checking your browser" CAPTCHA nonsense (challenges.cloudflare.com). Then look a…
As far as I can tell, after months of fighting being DDoSed by Anthropic and OpenAI across 50+ sites - Cloudflare also allows what it considers "good bots" through all of your bot blocking rules, with no option to turn this off unless you pay them money.
Re: Stay discoverable in search while disallowing AI training
#25Earlier quoted context omitted.
7 per minute. I use my high school’s website to test Internet connectivity bc the domain is short and they don’t do a TLS redirect (making it easy to detect WiFi portals).
neverssl.com
I use this too, but my high school url is 8 characters. neverssl.com is 12. :)
Re: Stay discoverable in search while disallowing AI training
#26If this admin is serious about AI growth they’d make anti-scrapping illegal.
I don't think this admin even knows what scraping is. Unless it's "scraping the bottom of the barrel", something they're very familiar with.
Re: Stay discoverable in search while disallowing AI training
#27Earlier quoted context omitted.
7 per minute. I use my high school’s website to test Internet connectivity bc the domain is short and they don’t do a TLS redirect (making it easy to detect WiFi portals).
neverssl.com
Wish the admin never added the SSL redirect, its literally the namesake lol
I just want basically captive.apple.com with a shorter domain and the webserver not even listening on port 443 at all.
Surprised someone hasn't made this yet, it only requires one spare public IP.
Re: Stay discoverable in search while disallowing AI training
#28"Cloudflare classifies bots by behavior, and a single bot can exhibit more than one behavior." Is that really true CF classifies anyone not using a popular browser with Javascript enabled as a "bot" CF fingerprints www users As an example, look at CF's Permissions-Policy HTTP response header on a site with CF "bot protection", i.e., the "checking your browser" CAPTCHA nonsense (challenges.cloudflare.com). Then look a…
CF classifies anyone not using a popular browser with Javascript enabled as a "bot"
This is my biggest complaint about CF. They are implicitly supporting user-agent discrimination in favour of Big Browser, instead of discriminating on actual behaviour.
...and of course there are already companies running tons of VMs with "officially sanctioned" browser + OS stacks, that can get past all these "protections", for a fee.
"AI bots" is the newest boogeyman they came up with to take away freedom.
Re: Stay discoverable in search while disallowing AI training
#29"Accountable" is just a fancy word for "pinky promise, but with a label." Nothing stops the data from ending up in a training run once it's already been fetched.
...and the only way to stop[1] that is by effectively DRM'ing everything, which is a level of dystopia that I don't think even Stallman ever anticipated, nor do I want to happen.
[1] Analog hole and other workarounds aside, naturally.
Re: Stay discoverable in search while disallowing AI training
#30If this admin is serious about AI growth they’d make anti-scrapping illegal.
Just make user-agent-discrimination illegal.