This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
AI models collapse when trained on recursively generated data
41–50 of 212 posts
Re: AI models collapse when trained on recursively generated data
#42This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#43This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#44This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#45This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#46This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#47This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#48This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#49This seems extremely interesting, but I don't have the time right now to read this in depth (given I would also need to teach myself a bunch of technical concepts too). Anyone willing to weigh in with a theoretical intuition ? The one in the paper is just a little inaccessible to me right now.
Re: AI models collapse when trained on recursively generated data
#50Meanwhile OpenAI, Anthropics, trains on AI generated data to improve their models, and it works. https://openai.com/index/prover-verifier-games-improve-legib... https://www.anthropic.com/research/claude-character
Cheese and Chalk. It is very different to generate synthetic datasets to assist in targeted training , vs ingesting LLM output from web scraping.
If synthetic data is mixed into your upstream data sources in a way you cannot control, then your ML team loses a valuable controllable parameter.