Live data from Hacker News

How can I prevent my site from being a free dataset for LLMs?

news.ycombinator.com

11–20 of 66 posts

Re: How can I prevent my site from being a free dataset for LLMs?

#13
post #9

For ChatGPT you can block it as per https://platform.openai.com/docs/plugins/bot For others, take same measures as unwanted traffic or scrapping.

It should be take permission first instead of this obscenity

No way. I want my AI trained on everything, not just pages that "opted in." If you don't want AI learning from your work, then don't publish it.

Re: How can I prevent my site from being a free dataset for LLMs?

#14
post #9

Earlier quoted context omitted.

It should be take permission first instead of this obscenity

No way. I want my AI trained on everything, not just pages that "opted in." If you don't want AI learning from your work, then don't publish it.

If we were talking about free, open-source AIs available to everyone (ironically, what OpenAI set out to become), I'd be inclined to agree with you. However, we're talking about commercialised AIs that scrape your intellectual property and turn it into a money printing machine without paying you a dime.

Re: How can I prevent my site from being a free dataset for LLMs?

#16

Require a login to read beyond the first paragraph

This is the only way. Yes, a reputable company operating in a country that respects laws will respect your robots.txt or some sort of future no-ai tag. But everyone else won't.

captcha is a way too

Re: How can I prevent my site from being a free dataset for LLMs?

#20
post #16

Earlier quoted context omitted.

This is the only way. Yes, a reputable company operating in a country that respects laws will respect your robots.txt or some sort of future no-ai tag. But everyone else won't.

captcha is a way too

Captchas will not last much longer.
Post reply on HN