So far what we have learned is that robots.txt doesn't work; major sites are using login-only access with 2FA to have any hope to keep their content away from LLMs. I imagine the licenses would be one thing, but actually implementing/enforcing them might be a whole other can of worms!
Ask HN: Is there any license that is designed to exclude LLMs?
1–10 of 20 posts
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#2Re: Ask HN: Is there any license that is designed to exclude LLMs?
#3Any licence that requires attribution should be enough in principle , eg CC BY 4.0, Apache 2.0.
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#4Any licence that requires attribution should be enough in principle , eg CC BY 4.0, Apache 2.0.
Thanks, I suspect the LLM companies would ignore this, and of course getting into a legal battle is beyond the means of most content producers. so perhaps the license is not the solution, and we need to create a complete world outside http...
However, for a laugh, I just made all the textual content on my key site explicitly CC BY 4.0. Most of my code is already Apache 4.0 and data CC0.
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#5Re: Ask HN: Is there any license that is designed to exclude LLMs?
#6hehehheh's comment is your best option - poison your content when possible. It's still going to be consumed but at least you can make the LLMs choke on it. Second best option is to never post content to the free internet, but even that's just a temporary measure - all accessible data (including private data) will be assimilated eventually.. But expecting a license to work in a post LLM world is just naive.
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#7Any licence that requires attribution should be enough in principle , eg CC BY 4.0, Apache 2.0.
Thanks, I suspect the LLM companies would ignore this, and of course getting into a legal battle is beyond the means of most content producers. so perhaps the license is not the solution, and we need to create a complete world outside http...
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#8You don't have a choice. Any content you put online will be harvested by LLMs regardless of your intent, or any license you post to the contrary. That's already the norm and it isn't going to change any time soon. hehehheh's comment is your best option - poison your content when possible. It's still going to be consumed but at least you can make the LLMs choke on it. Second best option is to never post content to the…
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#9If machine learning is not found to be fair use, and your concern is the removal of attribution, then MIT license should be fine.
> So far what we have learned is that robots.txt doesn't work;
The companies training models I'm aware of[0][1][2] all respect robots.txt for their crawling. Can't necessarily guarantee that all of them do - but the fact that smaller players are likely to use CommonCrawl (which also follows robots.txt[3]) means it should catch the vast majority of cases and I'd recommend it if you don't want your work trained on.
> major sites are using login-only access with 2FA to have any hope to keep their content away from LLMs
I suspect it's more that users with accounts are more valuable than lurkers, and framing forced sign-up as protecting user data from LLMs is a convenient excuse.
[0]: https://platform.openai.com/docs/bots
[1]: https://support.anthropic.com/en/articles/8896518-does-anthr...
[2]: https://blog.google/technology/ai/an-update-on-web-publisher...
Re: Ask HN: Is there any license that is designed to exclude LLMs?
#10You best bet to fight back is to either try to poison your data, or to train your own models on their data.