https://localroger.com/prime-intellect/mopiidx.html
[deleted]
Prime Agent: A self-improving RLM agent
11–20 of 81 posts
Re: Prime Agent: A self-improving RLM agent
#12Earlier quoted context omitted.
PrimeIntelect is not on official ARC-AGI-3 leaderboard: https://arcprize.org/leaderboard
Good to know! Is it that it wasn't accepted yet, or are there issues with how it was run?
It’s a self-improving harness, and ARC-AGI-3 is explicitly a few-shot benchmark. It’s likely that it gave itself more than the maximum number of tries to learn the games, or even hardcoded the answers.
There’s a lot of improvement to be had from the benchmark harnesses, but sometimes, like with ARC-AGI-3, the limitations are intentional.
Re: Prime Agent: A self-improving RLM agent
#13https://localroger.com/prime-intellect/mopiidx.html
For everyone downvoting: It's literally a story about the creation of mankind's first artificial general intelligence, Prime Intellect, and the consequences of that discovery.
Re: Prime Agent: A self-improving RLM agent
#14LLM-generated code that seemingly went without much review or design is always such an interesting dive into just how bloated you can make code. In this repository, multiple files are close to 10K LOC, one file contains a switch statement that has so many case statements it spans more than 1000 lines, and lots of other fun stuff. I guess it depends on the model you're trying to use, but seems most of them prefer smal…
Bash is all you need.
Re: Prime Agent: A self-improving RLM agent
#15A write up on RLM (Recursive Language Models) by one of the authors of the RLM paper:
Re: Prime Agent: A self-improving RLM agent
#16I built one of these RLM harnesses and a local MCP server along with logging, memories, and project rules based on directories. It worked great for a while but the foundational models have largely caught up to the point where they don't need this harness anymore. At least for my use cases. I can basically just store context in .md in the directories we work out of together and accomplish what I need.
The core idea of the RLM paper is to make a regular LLM act more like a coding agent - offload context to something external that needs to be explicitly queried instead of filling up valuable context. The "recursion" part of the paper really only wins because they use a top-tier model for the root agent, and cheaper models for the sub-agents.
Prime Agent took the RLM idea (which is really just an academic view on how coding agents have always worked) and then added this "continual harness" idea. This part isn't super well described in the blog post, but includes some message passing between the agents, and the ability to share code.
Overall I chalk it up as neat, but not revolutionary. Another version of what most of these systems are already doing.
Re: Prime Agent: A self-improving RLM agent
#17I built one of these RLM harnesses and a local MCP server along with logging, memories, and project rules based on directories. It worked great for a while but the foundational models have largely caught up to the point where they don't need this harness anymore. At least for my use cases. I can basically just store context in .md in the directories we work out of together and accomplish what I need.
I went the skills route - skill improvement skill and a rule to use it always. Basically it's directed that if anything causes more than a hop of thinking - failure - try something else it should flag that it needs to learn it as a skill so it never does it other than first shot again or if an existing skill fails improve it after it solves whatever problem. it then syncs the files to a shared location and updates the version and also pulls new skills. this let's a team use it or you have multiple workstations.
Re: Prime Agent: A self-improving RLM agent
#18https://localroger.com/prime-intellect/mopiidx.html
For everyone downvoting: It's literally a story about the creation of mankind's first artificial general intelligence, Prime Intellect, and the consequences of that discovery.
I feel that more warning is needed for this book. Everything you’ve stated is true, but the book’s first chapter contains some of the most disturbing depictions of stuff I don’t know I can type here on HN. Additionally, the last chapter put a really bad taste in my mouth.
That said, the stuff that deals with AI and its implications on the universe was great and more relevant than ever. The way PI works is pretty similar to how we use subagents to tackle large repos!
Re: Prime Agent: A self-improving RLM agent
#19Earlier quoted context omitted.
For everyone downvoting: It's literally a story about the creation of mankind's first artificial general intelligence, Prime Intellect, and the consequences of that discovery.
I feel that more warning is needed for this book. Everything you’ve stated is true, but the book’s first chapter contains some of the most disturbing depictions of stuff I don’t know I can type here on HN. Additionally, the last chapter put a really bad taste in my mouth. That said, the stuff that deals with AI and its implications on the universe was great and more relevant than ever. The way PI works is pretty simi…
yea the beginning is pretty gory / horrific. it almost made me stop reading but you can't deny the world building is.. unique
Re: Prime Agent: A self-improving RLM agent
#20LLM-generated code that seemingly went without much review or design is always such an interesting dive into just how bloated you can make code. In this repository, multiple files are close to 10K LOC, one file contains a switch statement that has so many case statements it spans more than 1000 lines, and lots of other fun stuff. I guess it depends on the model you're trying to use, but seems most of them prefer smal…
> one file contains a switch statement that has so many case statements it spans more than 1000 lines
Probably best to leave YandereDev's code out of the training data.