When AI Builds Itself: Our progress toward recursive self-improvement
1–10 of 738 posts
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#2AI tech bro:
Month 1 - 6 months to AGI
Month 2 - We will Replace all jobs
Month 3 - Okay maybe only the SWEs, programming is solved
Month 4 - Announce model that is too dangerous to release
Month 5 - Releases dangerous model
Month 6 - This is it! We will replace AIs with more AIs (*secretly files for IPO)
AI is here to stay, like it or not but it is not the solution to everything. If it is, what is Anthropic's moat? A better model? I don't see any ecosystem being built by them, as MCP is almost obsolete except for some very niche use case. And they're doing stuff that a non-profit version of OpenAI would do. Can we trust a for-profit company to stand against their investors during a conflict of interest? Because running a company for maximum profit versus being ethical is two different end of the spectrum.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#3Is this the moment when the AI gets permission to approve its own PRs:
https://www.italianrenaissance.org/wp-content/uploads/2012/0...
Or is this?
https://www.egypttoursportal.com/images/2024/02/Ouroboros-Sy...
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#4Sorry but if AI can build itself then it can run companies of size 3000 companies with a few people. Or even higher. What are the consequences?
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#5Sorry but if AI can build itself then it can run companies of size 3000 companies with a few people. Or even higher. What are the consequences?
When AI is a more effective capital allocator than NI it will drive capital into the accounts of whoever controls the AI, gaining them increasing decision making power over the economy and culture. Maybe those controllers will be human at first.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#6The mythos public release will be a big indicator if the Anthropic and SF story of transformational ai soon holds any water imo
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#7Another article about how anthropic wants to ban everyone except themselves and destroy opensource and chinese AIs.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#8Quite aligned with my own experience from harness engineering and winning AI4Science hackathon. During the hackathon I was working as a human optimizer, moving the feedback from test harness running on Claude Code, back to my local Claude Code for analysis-hypothesis-proposal cycle. And in this moment I realized that 2 Claudes talking to each other could actually scale much better.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#9> We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology. The Anthropic Institute will conduct research—in collaboration with many others—and take actions to help build the systems that a credible slowdown or pause would require.
Interesting - they're commiting to kickoff policy conventions to organize a world-slowdown of frontier LLM building. If they actually are able to crack it, this will give a much needed breather IMO. As exciting as the last ~6 months have been, there's some bigger questions to go answer now.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#10Another article about how anthropic wants to ban everyone except themselves and destroy opensource and chinese AIs.
Where is this discussed in the article? I don't see any mentions of China or open source models