You'd think we'd be concerned about it poisoning the culture, well before any concerns that it would start to interfere with the rich continuing to be able to profit from it doing so.
AI-Generated Data Can Poison Future AI Models
21–30 of 87 posts
Re: AI-Generated Data Can Poison Future AI Models
#22Human created content is also filled with gibberish and false information and random noise… how is AI generated content worse?
Re: AI-Generated Data Can Poison Future AI Models
#23Human created content is also filled with gibberish and false information and random noise… how is AI generated content worse?
Imagine you have a calculator that outputs a result that is off by one percent. That's ai right now.
If you use the results of each calculation in additional calculations, the result will skew further and further from reality with each error. That's ai training on itself.
Re: AI-Generated Data Can Poison Future AI Models
#24Human created content is also filled with gibberish and false information and random noise… how is AI generated content worse?
Arsenic naturally occurs... how are automatic factories that dump millions of tons it in the nearby river worse?
Re: AI-Generated Data Can Poison Future AI Models
#25Kessler syndrome for the internet?
Re: AI-Generated Data Can Poison Future AI Models
#26> AI-Generated Data Can Poison Future AI Models
Looks like we didn't learn anything from the mad cow disease!
Re: AI-Generated Data Can Poison Future AI Models
#27Human created content is also filled with gibberish and false information and random noise… how is AI generated content worse?
Imagine you have a calculator that outputs a result that is off by one percent. That's ai right now. If you use the results of each calculation in additional calculations, the result will skew further and further from reality with each error. That's ai training on itself.
In many areas of communication and information, this exact problem is dealt with through error correction codes. Do AI models have built in ECC?
Re: AI-Generated Data Can Poison Future AI Models
#28Earlier quoted context omitted.
Imagine you have a calculator that outputs a result that is off by one percent. That's ai right now. If you use the results of each calculation in additional calculations, the result will skew further and further from reality with each error. That's ai training on itself.
In many areas of communication and information, this exact problem is dealt with through error correction codes. Do AI models have built in ECC?
The trouble is "truth" and math are different.
You can verify a mathematical result. You can run the calculations a second time on a separate calculator (in fact some computers do this) to verify the result, or use a built in check like ecc.
There's no such mathematical test for truth for an ai to run.
Re: AI-Generated Data Can Poison Future AI Models
#29Human created content is also filled with gibberish and false information and random noise… how is AI generated content worse?
> how is AI generated content worse?
This is a crucial question.
In human society, a feedback loop of nonsense is usually defeated by practical effects in physical reality and experience. The objective of education, for example, is to transmit knowledge and apply reason to important questions.
In manipulated social media, there is no check on the nonsense loop. The technology that we currently call A.I. could be used for educational good.
How it will be used, however, is likely to further distort discourse and generate nonsense.
Re: AI-Generated Data Can Poison Future AI Models
#30I think it's interesting that human minds generally (though not always!) improve when exposed to the output of other human minds. It seems to be the opposite for current LLMs.
Have you ever heard of the telephone game? This is what is going on here. Or imagine an original story of something that really happened. If it goes by 100 people in a chain, how much do you think the story will resemble the original one?