[deleted]
Recursive Language Models (RLMs)
31–38 of 38 posts
Re: Recursive Language Models (RLMs)
#32Briefly, an RLM wraps an existing language model (LM) together with an environment that can dynamically manipulate the prompt that will be fed into the LM. The authors use as an environment a Python REPL that itself can call other instances of the LM . The prompt is programmatically manipulated as a Python variable on the REPL. The motivation is for the LM to use Python commands, including commands that call other LM…
A comparison to dSPY would be nice. cmd+f in the provided link doesn't bring any results tho...
Re: Recursive Language Models (RLMs)
#33Briefly, an RLM wraps an existing language model (LM) together with an environment that can dynamically manipulate the prompt that will be fed into the LM. The authors use as an environment a Python REPL that itself can call other instances of the LM . The prompt is programmatically manipulated as a Python variable on the REPL. The motivation is for the LM to use Python commands, including commands that call other LM…
Sounds like unforgivable overhead for very questionable benefits, this whole LLM space is an overengineered slop, and everyone is jumping in building layers on top of layers of slop.
Re: Recursive Language Models (RLMs)
#34IMO the author is a little over-claiming this work by naming 'recursive'. Quote from this blog:
> Lastly, in our experiments we only consider a recursive depth of 1 — i.e. the root LM can only call LMs, not other RLMs.
> but we felt that for most modern “long context” benchmarks, a recursive depth of 1 was sufficient to handle most problems.
I don't think a size 2 call stack algorithm should be regarded as 'recursive'.
Re: Recursive Language Models (RLMs)
#35Briefly, an RLM wraps an existing language model (LM) together with an environment that can dynamically manipulate the prompt that will be fed into the LM. The authors use as an environment a Python REPL that itself can call other instances of the LM . The prompt is programmatically manipulated as a Python variable on the REPL. The motivation is for the LM to use Python commands, including commands that call other LM…
A comparison to dSPY would be nice. cmd+f in the provided link doesn't bring any results tho...
An RLM is like a language model using DSPy plus all of Python to manipulate its prompt.
Re: Recursive Language Models (RLMs)
#36Earlier quoted context omitted.
Loops aren’t recursion?
Loops and recursion are fundamentally equivalent. See e.g. https://textbooks.cs.ksu.edu/cc210/16-recursion/08-recursion...
Only if you have indexable memory that you can use as a stack, which in the context of LMs isn’t a given.
As another example, a finite-state-machine language can have loops, but it can’t recurse unless there is external memory it has access to in a way that it can serve as a stack. Regular expressions also fall into that pattern; they can loop, but they can’t recurse. For that you need a pushdown automaton: https://en.wikipedia.org/wiki/Pushdown_automaton.
Re: Recursive Language Models (RLMs)
#37https://arxiv.org/abs/2510.04871 another recursive based model
> TRM obtains 45% test-accuracy on ARC-AGI-1 and 8% on ARC-AGI-2, higher than most LLMs (e.g., Deepseek R1, o3-mini, Gemini 2.5 Pro) with less than 0.01% of the parameters.
Re: Recursive Language Models (RLMs)
#38a model calls another (not self) model, which in turn returns without calling anything else. What you'ce discovered is called a function call.
It simply hopes two drunks are more coherent than one drunk.