Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

181–190 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#181

Earlier quoted context omitted.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

Why the hell does it need to be so complex? People have been making TUIs for decades. Did we need a small game engine to run claude code?

Must have 120 fps for answers arriving in [buffering] 30 seconds.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#183

I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.

They obviously don't care, aren't making any attempt whatsoever to do this, and 99% of users don't care either.

If you want to pollute your own priors with weird artificial litmus tests, it's a free country, but the artificial world-model you build in your head does not affect the real world around you.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#184

I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.

Developers can develop leaner applications, but they're usually not incentivized to. Frankly, I love efficiency too, but I've hard to learn the hard way that what the market wants is features . Or at the very least, the executive team wants that.

Their whole argument is that AI's added efficiency means they don't need to set aside valuable human time anymore. Why can't they just point Claude at Claude Code and ask it to reduce memory usage by 90%?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#185

Earlier quoted context omitted.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

Why the hell does it need to be so complex? People have been making TUIs for decades. Did we need a small game engine to run claude code?

They forgot to add 'make it as simple as possible' in the prompt is one possible cause.

On a more serious note using a react-like lib for TUI in the hope you'll share the codebase with the web version is a more likely explanation. Still not the best idea.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#186

So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.

I think that's a valid point. You could very well be right.

But we're discussing whether we should close the barn door while the horse is three miles down the road.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#187

So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.

"does anyone else feel like they shouldn't be allowed to?"

No. Technical limitations aside, I doubt it could be contained, but will be leaked soon, so won't profit just a small number of ultra rich.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#188
post #88

Earlier quoted context omitted.

Infrastructure is a much harder problem. They can't even improve Claude Code, which eats 1GB+ of RAM. Meanwhile, my editor only consumes 80MB of RAM.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

> For each frame our pipeline constructs a scene graph with React then

> -> layouts elements

> -> rasterizes them to a 2d screen

> -> diffs that against the previous screen

> -> finally uses the diff to generate ANSI sequences to draw

Yup. Overengineering.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#189
'“Good code” means two things: it works, and it is written in a manner that allows another engineer to understand it and build upon it.'

I disagree with this. Good code is easy to change, which is much harder to accomplish than code that can be added to.

"If technical trends in advancing capabilities continue, and AI systems are able to develop the capabilities inherent to transformative human ingenuity, then it is plausible that AI systems could design and refine themselves."

I find the first premise weak and implausible, and the second one is obviously false. To me it comes across as an insult to the reader.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#190

So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.

Too late for that.

In any case firms that get too powerful can be nationalised.

Post reply on HN