[dead]
Dream-RSI: Recursive Self-Improvement through Evolving Worlds
11–20 of 59 posts
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#12[dead]
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#13This is a solid and very interesting paper! The authors were kind enough to publish the complete prompt for it (appendix B.1 on page 18), so anyone can try their approach with any LLM and see the results.
So its more like a harness (like Codex etc) on top of any existing LLM?
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#14Would be very glad if anyone explained to me if and why this is revolutionary.
Why would you assume it is revolutionary?
Because “recursive self-improvement” is widely understood, even at labs, as having a non-trivial chance of eradicating human life.
This is like asking why a paper called “I discovered God. This is the specific proof.” is revolutionary. Just tedious levels of incredulity.
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#15Unless I'm misunderstanding, calling this RSI seems misleading? This looks like an optimization of current training methods, and a good one, but not "RSI" in the sense of a system that can perpetually improve itself forever.
Does RSI actually mean anything specific anymore? RSI, AGI, at this point seem like buzzwords. Sure AGI has definition that are measurable, say "better than 95% of humans on 95% of intellectual tasks" but if we used that definition we already have AGI and almost no one thinks we have achieved AGI. We use AIs to train AIs which we use to train AIs, why is that not RSI? How much human intervention means that is not RSI?
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#16I ended up building a simplified version of this as /self-improve in https://github.com/DanMcInerney/orchflows. History is the state ledger, memory and RSI just cite the history as evidence and can be rewritten. I feel like strong immutable state is the missing piece of the puzzle for most of these memory libraries.
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#17Unless I'm misunderstanding, calling this RSI seems misleading? This looks like an optimization of current training methods, and a good one, but not "RSI" in the sense of a system that can perpetually improve itself forever.
Yeah, this is absolutely not what anyone reasonable is thinking about when they say recursive self-improvement.
I'd say it's much closer to the concept of continual learning, but I'm only a few pages deep and haven't groqued it fully yet.
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#18I might be wrong but is this really a solution for RSI? I interpret it's as a way to reducing wasted tokens and compute on paths that don't yield better results. It's an optimization. It's a faster way to get to RSI though. what's wrong?
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#19The replay simulator from history for off-policy eval is clever - avoids expensive rollouts. Curious how they prevent the policy from overfitting to already-discovered branches and going stale as the search space expands?
Re: Dream-RSI: Recursive Self-Improvement through Evolving Worlds
#20Earlier quoted context omitted.
Why would you assume it is revolutionary?
Because “recursive self-improvement” is widely understood, even at labs, as having a non-trivial chance of eradicating human life. This is like asking why a paper called “I discovered God. This is the specific proof.” is revolutionary. Just tedious levels of incredulity.
[deleted]