[dead]
Miasma: A tool to trap AI web scrapers in an endless poison pit
41–50 of 276 posts
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#42My asthmar
I'm assuming this is a reference to Lord of the flies
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#43This is ultimately just going to give them training material for how to avoid this crap. They'll have to up their game to get good code. The arms race just took another step, and if you're spending money creating or hosting this kind of content, it's not going to make up for the money you're losing by your other content getting scraped. The bottom has always been threatening to fall out of the ads paid for eyeballs,…
> This is ultimately just going to give them training material for how to avoid this crap.
> The arms race just took another step, and if you're spending money creating or hosting this kind of content, it's not going to make up for the money you're losing by your other content getting scraped.
So we should all just do nothing and accept the inevitable?
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#44> If you have a public website, they are already stealing your work. I have a public website, and web scrapers are stealing my work. I just stole this article, and you are stealing my comment. Thieves, thieves, and nothing but thieves!
If someone hands out cookies in the supermarket, are you allowed to grab everything and leave?
Odd thing about cookies… they disappear after one serving.
Websites are an endless stream of cookies.
The analogy doesn’t hold.
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#45Why not simply blacklist or rate limit those bot IP’s ?
The AI companies are using virtually unlimited "clean" residential IPs so this is not a valid strategy.
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#46Earlier quoted context omitted.
If someone hands out cookies in the supermarket, are you allowed to grab everything and leave?
Odd thing about cookies… they disappear after one serving. Websites are an endless stream of cookies. The analogy doesn’t hold.
Digital information may be our first post-scarce resource. It's interesting, and sad, to see so many attempt to fit it within scarcity-based economic models.
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#47This is ultimately just going to give them training material for how to avoid this crap. They'll have to up their game to get good code. The arms race just took another step, and if you're spending money creating or hosting this kind of content, it's not going to make up for the money you're losing by your other content getting scraped. The bottom has always been threatening to fall out of the ads paid for eyeballs,…
Tech is just a series of arms races
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#48Why do this though? It's like if someone was trying to "trap" search crawlers back in the early 2000s. Seems counterproductive
search crawlers used to bring people TO your site
llm boots are used to keep people OUT of your site, because knowledge is indexed and distributed by corporations.
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#49> If you have a public website, they are already stealing your work. I have a public website, and web scrapers are stealing my work. I just stole this article, and you are stealing my comment. Thieves, thieves, and nothing but thieves!
If someone hands out cookies in the supermarket, are you allowed to grab everything and leave?
This is a dishonest analogy. In your example, there is only a limited amount of cookies available. While there is no practical limit on the amount of time a certain digital media can be viewed.
You are allowed to take one cookie. But you are allowed to view a public website multiple times if you so want.
Re: Miasma: A tool to trap AI web scrapers in an endless poison pit
#50Earlier quoted context omitted.
Even it did work, I just can't bring myself to care enough. It doesn't feel like anything I could do on my site would make any material difference. I'm tired.
I definitely get this. The thing that gives me hope is that you only need to poison a very small % of content to damage AI models pretty significantly. It helps combat the mass scraping, because a significant chunk of the data they get will be useless, and its very difficult to filter it by hand
The asymmetry is what makes this very interesting. The cost to inject poison is basically zero for the site owner, but the cost to detect and filter it at scale is significant for the scraper. That math gets a lot worse for them as more sites adopt it. It doesn't solve the problem, but it changes the economics.