AI-Generated Data Can Poison Future AI Models
scientificamerican.com
AI-Generated Data Can Poison Future AI Models
1–10 of 87 posts
Re: AI-Generated Data Can Poison Future AI Models
#2Certain words, like "groundbreaking", have been totally ruined for me by LLMs which are too often trained to sound like each other.
Re: AI-Generated Data Can Poison Future AI Models
#3Re: AI-Generated Data Can Poison Future AI Models
#4I think it's interesting that human minds generally (though not always!) improve when exposed to the output of other human minds. It seems to be the opposite for current LLMs.
Re: AI-Generated Data Can Poison Future AI Models
#5Unless the internet is no longer useful because there is no way to find anything reliable, there would be enough signal to train and align models.
Re: AI-Generated Data Can Poison Future AI Models
#6I think it's interesting that human minds generally (though not always!) improve when exposed to the output of other human minds. It seems to be the opposite for current LLMs.
Maybe it's less about "Human VS Robot" and more about exposure to "Original thoughts VS mass-produced average thoughts".
I don't think a human mind would be improving if they're in a echo-chamber with no new information. I think the reason the human mind is improving is because we're exposed to new, original and/or different thoughts, that we hadn't considered or come across before.
Meanwhile, a LLM will just regurgitate the most likely token based on the previous one, so there isn't any originality there, hence any output from a LLM cannot improve another LLM. There is nothing new to be learned, basically.
Re: AI-Generated Data Can Poison Future AI Models
#7Some perspectives from someone working in the image space.
These tests don't feel practical - That is, they seem intended to collapse the model, not demonstrate "in the wild" performance.
The assumption is that all content is black or white - AI or not AI - and that you treat all content as equally worth retraining on.
It offers no room for assumptions around data augmentation, human-guided quality discrimination, or anything else that might alter the set of outputs to mitigate the "poison"
Re: AI-Generated Data Can Poison Future AI Models
#8This reminds me of how fascinated I was as a kid of the artifacts you get from recursively photocopying a piece of paper.
Re: AI-Generated Data Can Poison Future AI Models
#9I think it's interesting that human minds generally (though not always!) improve when exposed to the output of other human minds. It seems to be the opposite for current LLMs.
Different loss function
Re: AI-Generated Data Can Poison Future AI Models
#10Unless the internet is no longer useful because there is no way to find anything reliable, there would be enough signal to train and align models.
Dead internet theory is closer and closer
I don't remember wich YouTuber made a interesting video about it but basically communities are moving away from the free web in private communities (think discord or even sites that you are forced to register to to read the content)
It's an interesting thing but I think queries on searche engines are becoming worse for this reason too.