Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

561–570 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#561

Earlier quoted context omitted.

image a streamlined model whose only job is to build then execute the harness at the speed youre seeing in chat jimmy.

Speed isn't really a big deal for me. I want good quality code. It's already able to generate code 10-100X as fast as I could code it myself. Anyway, are you speaking of the harness? The harness on mine isn't AI, so speed just isn't an issue.

> Generated in 0.008s • 14,293 tok/s

Chat Jimmy runs ~300X faster than the ~50 tok/s you are used to. What could you do differently when you are able to generate code 3,000 - 30,000X as fast as you could code it yourself? What if it was all good quality code? What would you do differently if it were 100,000X faster? mtok/s? gtok/s?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#562
This is relevant because Anthropic is currently cast as serving mainly the coding market.

If/since their AI+process can help build new models, they can target other markets, and other companies seeking to build for such markets will partner with them first.

There's no moat and little first-mover advantage in the general-purpose AI, but there may be both in specialized AI.

Also, there are other reasons to get better. Changing how you build models can enable you to adapt to different hardware, avoiding the current Nvidia margins.

The difference between early Yahoo and Google was mainly that Google was the adult in the room: minimally invasive and mostly helpful. The early goodwill towards Google has reaped decades of rewards. I see OpenAI and Anthropic playing out the same way.

The amplifier here is the reputational risk of partnering with one or the other; I think companies would prefer to be Anthropic's partner because it's demonstrating more care, and it's less likely to horn in on the partner market (as a provider for coding but an enabler for other markets).

These attractive second-order derivatives - flywheel effect, monopoly power - are often claimed, but Anthropic is mainly providing evidence to track actual progress.

(However, if I were head of messaging at Anthropic, I would rigorously stay away from treating AI as a person; it's as agent, a delegate of humans. So I'd never say AI could build itself, just that we're getting better at building better models with AI).

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#563

I don't quite understand the intent of such article other than to promote themselves given an odd timing that the company is planning on going public, so I can only conclude that this is just part of the IPO roadshow. LLMs certainly have made significant changes to our lives, but I haven't yet to see any extraordinary improvement it brought to me which makes me skeptical about their claims. _if_ it solves many of our…

The article does not claim they have achieved recursive self improvement... just that it appears to be a plausible outcome given the progress of AI development in the past few years.

I don't know about you, but AI advancements have brought extraordinary improvements to me personally in my ability to be productive, in much the same ways the article outlines. I find it deeply satisfying to be able to "get ideas out of my head" faster and tackle more meaningful problems.

FWIW, it deeply concerns me how much power and capability is being centralized in the hands of so few, especially Anthropic. I, for one, hope these advancements can be scaled down to something I can have full sovereignty over and trust... in my own home.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#564
post #98

Earlier quoted context omitted.

> mine also makes extensive use of things like abstract syntax tree library to help with surgical edits from the LLM Tell me more! This takes me way back. I did one like this in the GPT-4 days! (8k context window)

Start off with my video!!! You can also try it with zero setup (you can code right there on the static web page, it will save your edits in the browser indexed DB, and hotpatch them back into the code before it runs it.... also you can grant permission to the browser to read/write to a local directory) recursi.dev Seriously, I'm looking for collaborators. There's upwards of 80,000 lines of code in the editor system,…

remove the images from the url, i stared at the page for 3 secs waiting for something to show up (gigabit connection)

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#565
post #531

Earlier quoted context omitted.

Not advocating for AI code slop--but if AI coded software works correctly, maybe it doesn't matter? Except sometimes when a specialist will have to get involved. Not a perfect analogy, but most people don't write assembly these days--they have a compiler do that. Assembly still has a place, but it's a specialist task.

> if AI coded software works correctly, maybe it doesn't matter? The problem isn't the amount of code, it's how fitting/unfitting the abstractions are. Wrong abstractions are bugs in waiting. If there's much code with wrong abstractions, future change becomes difficult. Source: me, I've created many bad abstractions and they led to much pain...

Yeah. Its kind of strange - claude is great at some tasks, but it seems really rubbish at coming up with good abstractions a lot of the time. I've often caught it making a conceptual mistake (like "X cannot do Y") - then spending hundreds of lines working around an issue that doesn't actually exist.

Its also really bad at inventing and leaning on invariants. I make rules in my code all the time - "by the time we get to path X, we know Y and Z are true.". In aggregate, these invariants make code simpler and easier to reason about. But claude doesn't do that. It just kind of - slops through and adds bespoke "just in case" workarounds all over the place. Every time I read through code its written - without fail - I find bad design / architectural choices.

Maybe mythos will change this. But for now I've slowed way down on my claude code usage. You can't build a skyscraper on a foundation of mud.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#566

I don't quite understand the intent of such article other than to promote themselves given an odd timing that the company is planning on going public, so I can only conclude that this is just part of the IPO roadshow. LLMs certainly have made significant changes to our lives, but I haven't yet to see any extraordinary improvement it brought to me which makes me skeptical about their claims. _if_ it solves many of our…

Because they're going after the biggest problem of all first: labor costs. /s but not to a lot of people

Do you not think that the allocation of human time is one of the world’s biggest problems?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#567

Earlier quoted context omitted.

One of my co-workers just asked me to review his pull request that was all AI generated. 600 files were touched, over 40k lines of code added. I'm sure he thought that was a crowning achievement, proof that AI can enable 10X developers, after all, what engineer could write 40k lines of code in a week? I declined to review it, stating that I couldn't possibly vet 40k lines of code, and wouldn't put my reputation on th…

I declined to review it, stating that I couldn't possibly vet 40k lines of code Gee, that sounds like a job for Claude if there ever was one.

At work we had copilot. It said "the diff is too big to review"

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#570

I have been doing more experiments with what I have now been calling agentic iterative optimization: telling the LLM to optimize code such that it speeds up all real-world-representative benchmarks by X% without cheating or causing regressions in both tests and performance metrics (e.g. MSE for statistical algorithms or file size in the case of something such as image compression). This is done using Rust where there…

Very interesting, could you share they prompts you typically use for this? Something like this? You are an Elite Performance Engineer and Autonomous Optimization Agent. Your primary goal is to iteratively optimize the provided codebase to maximize execution speed and efficiency (e.g., reduce CPU cycles, memory allocation, or network latency) WITHOUT altering the external behavior or causing any test regressions. ###…

Depending on how complex the code is, you don't need that big prompt with ChatGPT.

I have sped up a project by simply saying "What are all the possible ways I can speed up this code?" Then it'll list everything it finds, then ask it to rewrite the code.

Edit: Also, I find I didn't need to do this (because a speed up implies semantic similarity), but you can also add "change it without altering the semantics of the code" and in this way it'll be the same and should pass tests

Post reply on HN