I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.
When AI Builds Itself: Our progress toward recursive self-improvement
91–100 of 738 posts
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#92Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…
Their outages are probably not due to their code though. It’s probably their infrastructure that can’t keep up. So seeing failures of infrastructure doesn’t really tell you anything about how good or bad Anthropic makes use of their models.
The messed up scrolling behavior I keep getting in Claude Code is definitely due to their code.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#93I'd use number of commits as a metric versus lines of code. A commit is generally a unit of work - regardless of the lines of code added/removed. It'd be interesting to see the metrics in terms of commits. I'm sure it's still an order of magnitude jump. Personally I'm flying with my own projects with AI, lots of commits, but I really try to minimize lines of code added. If I can remove and simplify existing code so the balance of lines added on commit are minimal - that's the path to a better quality app overall.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#94I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.
A came here just to write: Pretty please let it churn for a few nights and redo Claude Code in Rust. Because the harness is very very good as are their models, but that node thing is a hog for no good reason at all.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#95I have a claw that is instructed to make at least 500 pr per day. It uses Claude, Gemeni and openai and runs basically every few minutes. I use online forums for input for the claw. Moltbook, reddit etc. it's quite funny how it tries to improve itself. But to say it really creates a new skynet. Nah. Not at all. It's more a clutter of useless features or incomprehensible code restructuring.
This more or less agrees with my assessment of recent changes in Claude Code where a lot of new features are either: - A lot of half-baked features or half-done features. - Or have significant overlap with existing features, and aren’t clearly an improvement. More code is not better. More features are not better. It would be lovely to see more intentional design than just more. I know they’re dog fooding this. I have…
It's like the AI created a method add(a b) return a+a+a+a-b-b-b-b
But then much bigger and complex features. Totally useless nothing methods. But still interesting to see occasional exceptions that are better.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#96Do code harnesses that build themselves count as recursive self improvement, or does it need to be the AI itself to qualify for the term? I always was fascinated (obsessed?) by robots that build robots, or even things like this that can contribute a lot to making the next version of itself: https://buildyourcnc.com/products/cnc-machine-blacktoe-v4-2x... (cnc router that cuts plywood, and is made out of cnc-router cut…
If you want to get out ahead of what's coming, it'll be small models that bootstrap the harness rather than anything else.
I used to think that, but ended up going the other direction, partly because I don't have the wherewithall to build a model but then I realized, with existing models that can take more than a tiny amount of context, you can just let any model bootstrap itself with a good prompt sent by the system.
There's a ton of other tricks to it, but mostly keeping the protocol simple for the AI so it can concentrate on coding logic and not stuff like managing BS boilerplate, dependencies, etc. (for instance I make extensive use of things like abstract syntax tree library to help with surgical edits from the LLM)
That said, I would be very open to collaborating with someone who builds such small models, I don't think the system strictly needs it, but it also could have some extra power if it had it.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#97Do code harnesses that build themselves count as recursive self improvement, or does it need to be the AI itself to qualify for the term? I always was fascinated (obsessed?) by robots that build robots, or even things like this that can contribute a lot to making the next version of itself: https://buildyourcnc.com/products/cnc-machine-blacktoe-v4-2x... (cnc router that cuts plywood, and is made out of cnc-router cut…
I think harnesses would count, AI != LLMs. Any piece of code that helps the computer reason for itself is AI, the harnesses are AI in a sense.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#98Earlier quoted context omitted.
If you want to get out ahead of what's coming, it'll be small models that bootstrap the harness rather than anything else.
I used to think that, but ended up going the other direction, partly because I don't have the wherewithall to build a model but then I realized, with existing models that can take more than a tiny amount of context, you can just let any model bootstrap itself with a good prompt sent by the system. There's a ton of other tricks to it, but mostly keeping the protocol simple for the AI so it can concentrate on coding lo…
> mine also makes extensive use of things like abstract syntax tree library to help with surgical edits from the LLM
Tell me more! This takes me way back. I did one like this in the GPT-4 days! (8k context window)
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#99I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.
A came here just to write: Pretty please let it churn for a few nights and redo Claude Code in Rust. Because the harness is very very good as are their models, but that node thing is a hog for no good reason at all.
Incoming rust rewrite branch ready to merge: +1,009,257 -4,024
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#100Earlier quoted context omitted.
We should be skeptical of any major player that advocates for regulating their own industry. In practice, this just means increasing barriers to entry and making it harder to compete with them. In my mind we should be trying to push AI along the Linux trajectory. You have a free and open source product, developed by a decentralized team with a strong code of ethics, running on commodity hardware. There can still be t…
The regulation that is being argued for here is against pushing the frontier. Entering the market with say a new speech to text model is not subject to such regulation. What's needed is something qualitatively different from entry barriers, and of the frontier model companies at least Anthropic and deepmind seem to have enough self-awareness to speak about it. They are finding themselves in a race with possibly catas…
its a cartel looking to end competition though
the actual race is to keep having revenue, since everyone is still willing to pay more for the best model.
we as consumers of LLM models lose out by the arms race ending by the creation of a cartel
what happens if they get this regulatory capture is that all the frontier labs put effort into making inference cheaper, and become extraordinarily profitable, at the expense of us consumers, who really want better models, at a subsidized price