Recursive Language Models (RLMs)

For that issue, try Codex until Claude catches up to your style.

This is what Codex is doing. The LM has been trained to work well with the kinds of tools that a solid developer would use to navigate and search around a code repository and then to reason about what it finds. It’s also really competent at breaking down a task into steps. But I think the real magic - watching this thing for at least 40 of the last 50 working hours - is how it uses command line tools to dig through code quickly and accurately.

It’s not relying on the LM context much. You can generally code away for an hour before you run out of context and have to run a compression step or just start fresh.

this doesn't appear to bring anything new to the table.

please correct me if I'm wrong..this is just subagent architecture?

I’m not sure if I understood this correctly:

1.Recursion is used to break down the large context and dispatch to different LLM calls to get the useful context.

2.This may lead to longer test-time execution on large contexts (even with parallelism in deep recursion), and the monetary cost may increase rapidly.

I think it’s a different idea from using RAG or manually maintaining a context window

correct me if I'm wrong

Just wanted to say that I really like this question. Very thought-provoking :)

EDIT: makes me think of many computation systems in various substrates, and how they work. Focus vs distraction/creativity. ADHD workers in hierarchies of capitalism, purpose of breadth vs depth of exploration at various levels of the stack, who's at the "top" and why, etc etc