Earlier quoted context omitted.
For what it's worth, the big AI companies do have opt out mechanisms for scraping and search. OpenAI documents how to opt out of scraping here: https://developers.openai.com/api/docs/bots Anthropic documents how to opt out of scraping here: https://privacy.claude.com/en/articles/8896518-does-anthropi... I'm not sure if Gemini lets you opt out without also delisting you from Google search rankings.
I think opt-outs are a bit backwards, ethically speaking. Instead of asking for permission, they take unless you tell them to no longer do it from now on. I can imagine their models have been trained on a lot of websites before opt outs became a thing, and the models will probably incorporate that for forever. But at least for websites there's an opt-out, even if only for the big AI companies. Open source code never…
It was a dataset of the entirety of the public internet from the very beginning that bypassed paywalls etc, there’s virtually nothing they haven’t scraped.