Very interesting idea but without any concrete examples of performance on real tasks its just a pretty idea
Examples and ROI
Prime Agent: A self-improving RLM agent
61–70 of 81 posts
Re: Prime Agent: A self-improving RLM agent
#62Earlier quoted context omitted.
I vouch for this story, personally. I love it. I consider it a classic among science fiction novellas. It does include some brutal sadomasochism with graphic torture, that's true, and that's why it isn't better known. If that part bothers you, which is fair, I would skim past it. The story overall is quite worth it
Years and years ago I saw this story on k5 when it came out and never read it -- but from commentary I always thought was some sort of hard sci-fi exploration of what happens when we get AGI/ASI. So all these years later AI is real, I see the story again, and I figure, hey, why not read it. And how very surprised I was to find out it's basically a horny kink story with a little bit of AI/SF window dressing!
[deleted]
Re: Prime Agent: A self-improving RLM agent
#63https://localroger.com/prime-intellect/mopiidx.html
You shouldn't link that without mentioning that it is a particularly intense S&M/rape/incest fetish piece, and that the squick content is entirely integral to the story. I'm generally dubious of "trigger warnings" but if ever there was something that needed content tags-- this is it. If you imagine it being written for alt.sex.stories.moderated but somehow failing to be erotic by virtue of being too explicit, and bei…
You and everyone else saying so are correct; I forgot how bad it was when I posted the link. "Prime Agent" obviously used the story for branding or a callback, so this is 100% on-topic, but I should have re-examined what I was posting and added a warning.
Re: Prime Agent: A self-improving RLM agent
#64Earlier quoted context omitted.
got one in typescript? or node.js with javascript?
I'm adding python in a few minutes and then looking into other languages including javascript and typescript all with the same zero 3rd party dependencies approach also want to do clojure, unfortunately it looks like java does not come with json support out of the box
> also want to do clojure, unfortunately it looks like java does not come with json support out of the box
Clojure has clojure.data.json (https://clojure.github.io/data.json/), should be easy to use albeit not blazing fast exactly, doesn't really matter here though. Otherwise, you could use Babashka, comes with Cheshire (and others) out of the box.
Re: Prime Agent: A self-improving RLM agent
#65Earlier quoted context omitted.
I'm adding python in a few minutes and then looking into other languages including javascript and typescript all with the same zero 3rd party dependencies approach also want to do clojure, unfortunately it looks like java does not come with json support out of the box
> also want to do clojure, unfortunately it looks like java does not come with json support out of the box Clojure has clojure.data.json ( https://clojure.github.io/data.json/ ), should be easy to use albeit not blazing fast exactly, doesn't really matter here though. Otherwise, you could use Babashka, comes with Cheshire (and others) out of the box.
ty for the pointers
I like the babashka angle!
Re: Prime Agent: A self-improving RLM agent
#66Very interesting idea but without any concrete examples of performance on real tasks its just a pretty idea
They achieved 95% in ARC-AGI-3. [0]
Re: Prime Agent: A self-improving RLM agent
#67Earlier quoted context omitted.
How on Earth do we solve this bloat and death-by-a-thousand-cuts issue with frontier LLMs? Are there any actual solutions or attempts at solutions to this problem that I can try? Any tools or frameworks? I've tried re-architecture skills, dedicated cleanup sessions, and a bunch of other stuff, but nothing really works well.
Don't try to "run as fast as possible" and just add code willy-nilly, think about the design, refactor as you add new features/fixes and intentionally be a bit slower and more considerate. It's not a technical problem, if you steer the LLMs enough and actually review what they do, you can build proper and clean software with them.
Yeah, but that's boring. :)
Re: Prime Agent: A self-improving RLM agent
#68Earlier quoted context omitted.
here is a take on a smol agent ("smol") - 21 lines of Go - no 3rd party dependencies https://github.com/smol-env/smol easier to add and customize stuff when you start from a small base think of it as your starter dough
got one in typescript? or node.js with javascript?
The stuff 99% of agents are coded in? Please tell me this was sarcasm.
Re: Prime Agent: A self-improving RLM agent
#69Earlier quoted context omitted.
PrimeIntelect is not on official ARC-AGI-3 leaderboard: https://arcprize.org/leaderboard
Good to know! Is it that it wasn't accepted yet, or are there issues with how it was run?
leaderboard likely has results from "semi-private" dataset, and graph above likely from public dataset, so it can be easily overfit.
Re: Prime Agent: A self-improving RLM agent
#70https://localroger.com/prime-intellect/mopiidx.html
I vouch for this story, personally. I love it. I consider it a classic among science fiction novellas. It does include some brutal sadomasochism with graphic torture, that's true, and that's why it isn't better known. If that part bothers you, which is fair, I would skim past it. The story overall is quite worth it
>It appeared to listen intently as a man in a cleric's uniform railed. "God made all intelligent creatures," the man was saying in a powerful voice. "You may have the apprearance of thinking, but you are really just parroting the responses taught you by that man there." He pointed at Lawrence.