Skynet won and destroyed humanity
dmathieu.com
Skynet won and destroyed humanity
1–10 of 145 posts
Re: Skynet won and destroyed humanity
#2> But as it started consuming more and more data that it had produced itself, its reliability became close to none.
It's exactly the opposite with LLMs. See the "model collapse" phenomenon (https://www.nature.com/articles/s41586-024-07566-y).
> We show that, over time, models start losing information about the true distribution, which first starts with tails disappearing, and learned behaviours converge over the generations to a point estimate with very small variance. Furthermore, we show that this process is inevitable, even for cases with almost ideal conditions for long-term learning, that is, no function estimation error
Re: Skynet won and destroyed humanity
#3> But as it started consuming more and more data that it had produced itself, its reliability became close to none. It's exactly the opposite with LLMs. See the "model collapse" phenomenon ( https://www.nature.com/articles/s41586-024-07566-y ). > We show that, over time, models start losing information about the true distribution, which first starts with tails disappearing, and learned behaviours converge over the ge…
Aren't those saying the same thing? .. "its reliability became close to none" vs. "causes irreversible defects in the resulting models"
Re: Skynet won and destroyed humanity
#4[flagged]
Re: Skynet won and destroyed humanity
#5[flagged]
Actually, his dad did the creation bit (allegedly).
Re: Skynet won and destroyed humanity
#6Re: Skynet won and destroyed humanity
#7You can tell this was written by a human because they wrote that skynet still used violence in the end.
When there’s a large enough intelligence differential, the lower intelligence cannot even tell they are at war (let alone determine who’s winning)
Like the ants, unaware of the impending doom of 100 ways their colony is going to be destroyed by humanity - they couldn’t understand it even if we had the means to communicate with them.
Re: Skynet won and destroyed humanity
#8[flagged]
> and we are intelligent allegedly
My running joke about AI is how can we create artificial intelligence, when we lack so much of it. Sadly I spent more times failing to copy and paste your message than I care to admit.
I do gotta say though, it's a bit overhyped. It reminds me of crypto. If you listen to an "aibro" and a "cryptobro" they yap the same.
Re: Skynet won and destroyed humanity
#9> But as it started consuming more and more data that it had produced itself, its reliability became close to none. It's exactly the opposite with LLMs. See the "model collapse" phenomenon ( https://www.nature.com/articles/s41586-024-07566-y ). > We show that, over time, models start losing information about the true distribution, which first starts with tails disappearing, and learned behaviours converge over the ge…
Aren't those saying the same thing? .. "its reliability became close to none" vs. "causes irreversible defects in the resulting models"
There’s thing that happens in humans called “hallucination” where they just make up stuff. You can’t really just take it at face value. Sometimes, they’re just overfit so they generate the same tokens independent of input.
Re: Skynet won and destroyed humanity
#10[flagged]
> and we are intelligent allegedly My running joke about AI is how can we create artificial intelligence, when we lack so much of it. Sadly I spent more times failing to copy and paste your message than I care to admit. I do gotta say though, it's a bit overhyped. It reminds me of crypto. If you listen to an "aibro" and a "cryptobro" they yap the same.
I can do practical things with ai, I cannot with crypto. I can't speak to the accuracy of numerical valuations but in a shorter time frame I have perceived more changes from AI than crypto.