FOSS infrastructure is under attack by AI companies
thelibre.news
FOSS infrastructure is under attack by AI companies
1–10 of 631 posts
Re: FOSS infrastructure is under attack by AI companies
#2Could one put a mangler on the responses to suspected bots to poison their data sets with nonsense code.. :/
Re: FOSS infrastructure is under attack by AI companies
#3Yep -- our story here: https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse... (quoted in the OP) -- everyone I know has a similar story who is running large internet infrastructure -- this post does a great job of rounding a bunch of them up in 1 place.
I called it when I wrote it, they are just burning their goodwill to the ground.
I will note that one of the main startups in the space worked with us directly, refunded our costs, and fixed the bug in their crawler. Facebook never replied to our emails, the link in their User Agent led to a 404 -- an engineer at the company saw our post and reached out, giving me the right email -- which I then emailed 3x and never got a reply.
Re: FOSS infrastructure is under attack by AI companies
#4These are DDOS attacks and should be treated in law as such.
(Although I do realise that in many countries now we no longer have
any effective "rule of law")
Re: FOSS infrastructure is under attack by AI companies
#5...at some point, some people started appreciating mailing lists and the distributed nature of Git again.
Re: FOSS infrastructure is under attack by AI companies
#6Could one put a mangler on the responses to suspected bots to poison their data sets with nonsense code.. :/
This. Not only mangle the content. Flood the bot with tailored misinformation and things that are illegal in this particular legislation but not yours.
They will never respect you, but the second they notice this hurts their business more than it gains them, they will stop.
Re: FOSS infrastructure is under attack by AI companies
#7We're close to finding a clear use-case for Bitcoin with this one.
Re: FOSS infrastructure is under attack by AI companies
#8Could one put a mangler on the responses to suspected bots to poison their data sets with nonsense code.. :/
I wonder if that would just make them try harder. Scrape multiple times and diff, to gain confidence that the data hasn't been posioned.
We've never had one of these arms races end up with the defenders winning.
Re: FOSS infrastructure is under attack by AI companies
#9My question is, can we serve PoW challenges to these AI LLM scrapers that can be profitable?
Re: FOSS infrastructure is under attack by AI companies
#10Yep -- our story here: https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse... (quoted in the OP) -- everyone I know has a similar story who is running large internet infrastructure -- this post does a great job of rounding a bunch of them up in 1 place. I called it when I wrote it, they are just burning their goodwill to the ground. I will note that one of the main startups in the space worked with us direct…
> just burning their goodwill to the ground
AI firms seem to be leading from a position that goodwill is irrelevant: a $100bn pile of capital, like an 800lb gorilla, does what it wants. AI will be incorporated into all products whether you like it or not; it will absorb all data whether you like it or not.