Does this train on LLM output, or is this more like iterative self prompt improvement?
When AI Builds Itself: Our progress toward recursive self-improvement
11–20 of 738 posts
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#12Does this train on LLM output, or is this more like iterative self prompt improvement?
Have you tried reading the article? It answers your question.
Don't ask people to explain the article to you if you're too lazy to open it yourself.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#13Another article about how anthropic wants to ban everyone except themselves and destroy opensource and chinese AIs.
Where is this discussed in the article? I don't see any mentions of China or open source models
Not really mentioned explicitly but:
> A meaningful slowdown or pause would require multiple well-resourced labs at or near the frontier, in multiple countries, agreeing to stop under the same conditions. It would also require that each can verify that the others have actually stopped. Due to the unique characteristics of AI systems, the detectability (a lower standard than verifiability) element of this arms control problem is much more challenging than with other technologies. Training runs are far easier to conceal than missile silos, their inputs are general-purpose, and the incentive to defect quietly is enormous, because whoever continues while others pause could inherit the lead. A credible pause also has to specify what triggers it, what lifts it, and who adjudicates.
And later:
> In the coming months, we will organize conversations where policymakers, researchers, civil society, and other AI companies can help answer some of the questions this piece raises, especially around full recursive self-improvement and how to create better options for coordination and deliberation. We’ll publish what comes out of it. The window to investigate the questions together is here, and people outside AI companies should be involved in this deliberation.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#14So what happens when the world becomes hyper optimized with closed loop AI agents recursively trying to optimize everything deemed sub optimal?
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#15> We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology. The Anthropic Institute will conduct research—in collaboration with many others—and take actions to help build the systems that a credible slowdown or pause would require. Interesting - they're commiting…
We should be skeptical of any major player that advocates for regulating their own industry. In practice, this just means increasing barriers to entry and making it harder to compete with them.
In my mind we should be trying to push AI along the Linux trajectory. You have a free and open source product, developed by a decentralized team with a strong code of ethics, running on commodity hardware. There can still be trillion dollar industries built on top of it, but the core technology is democratized and available to everybody. I don't see how we get there if we allow a handful of companies to dictate where development of the technology goes.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#16I cannot wait for these models to tear down traditional social hierarchies. We havent even begun to see the effects, fingers crossed
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#17Re: When AI Builds Itself: Our progress toward recursive self-improvement
#18> A caveat: Lines of code is an imperfect measure, as it measures quantity over quality. So 8× lines of code/engineer/day in the second quarter of 2026 is almost certainly an overstatement of the true productivity gain. Nonetheless, it indicates an acceleration. At Anthropic, we don’t reward people for how many lines of code they write; rather, team members are producing more code simply because they’re using AI systems to write more code.
I simultaneously think the AI revolution is making real revolutionary gains and am mystified by the lying.
An accurate Translation seems to be “we made this shit up, but it feels right”
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#19So what happens when the world becomes hyper optimized with closed loop AI agents recursively trying to optimize everything deemed sub optimal?
[deleted]
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#20So what happens when the world becomes hyper optimized with closed loop AI agents recursively trying to optimize everything deemed sub optimal?
there will be a lot of paper clips