Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

Post reply on HN
Print view View original

131–140 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#131

Post by mweidner »

tokioyoyo wrote: post #126
mweidner wrote: post #119

I fail to see how pursuing recursive self-improvement at full speed is compatible with Anthropic's stated goal of AI Safety. If nukes were not invented yet, would it really be a good idea to build and sell them as fast as possible (in peace time, no less)? I am not cynical enough to believe that Anthropic's warnings are pure marketing hype. Let's hope that it is instead overconfidence or the result of too much time t…

Sorry for nitpicking, but: > If nukes were not invented yet, would it really be a good idea to build and sell them as fast as possible (in peace time, no less)? Arguably, yes.

Is the idea to keep the world in balance via MAD? I could see that, though it's a dangerous gamble.

From Richard Rhode's "The Making of the Atomic Bomb", I got the impression that most scientists involved thought they could manage a US or UN monopoly on nukes after the war. General Groves attempted to buy up all of the world's uranium ore. Unfortunately, it is only high grade ore that is rare; many countries have low-grade ore.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#132

Post by applfanboysbgon »

airstrike wrote: post #112
f311a wrote: post #88

Earlier quoted context omitted.

Infrastructure is a much harder problem. They can't even improve Claude Code, which eats 1GB+ of RAM. Meanwhile, my editor only consumes 80MB of RAM.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

I hadn't seen that quote before, what an embarrassing thing to go on the internet and write...

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#133

Post by tokioyoyo »

mweidner wrote: post #131
tokioyoyo wrote: post #126

Earlier quoted context omitted.

Sorry for nitpicking, but: > If nukes were not invented yet, would it really be a good idea to build and sell them as fast as possible (in peace time, no less)? Arguably, yes.

Is the idea to keep the world in balance via MAD? I could see that, though it's a dangerous gamble. From Richard Rhode's "The Making of the Atomic Bomb", I got the impression that most scientists involved thought they could manage a US or UN monopoly on nukes after the war. General Groves attempted to buy up all of the world's uranium ore. Unfortunately, it is only high grade ore that is rare; many countries have low…

Again quite arguable, but this is the real life scenario we’re living in. Nukes have made it hard to impossible for super major powers to go in direct conflict with each other.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#134

Post by dwa3592 »

To anyone who works at anthropic : I recently downgraded from Max to Pro out of frustration. Last few weeks my token(usage) burn was just too fast and I couldn't explain it because my actual usage was less than the last few months. I ended up thinking it's probably a bug that you guys shipped. The above article makes me think that it's probably claude who shipped the bug and your human missed it in their review.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#135

Post by nevertoolate »

parpfish wrote: post #46
damowangcy wrote: post #2

AI tech bro: Month 1 - 6 months to AGI Month 2 - We will Replace all jobs Month 3 - Okay maybe only the SWEs, programming is solved Month 4 - Announce model that is too dangerous to release Month 5 - Releases dangerous model Month 6 - This is it! We will replace AIs with more AIs (*secretly files for IPO) AI is here to stay, like it or not but it is not the solution to everything. If it is, what is Anthropic's moat?…

i'm waiting for the AI giants to realize that they are burning cash to run their consumer-facing chatbots and that they should kill those products to focus on their enterprise tools. free chatgpt doesn't need to exist anymore. its job was to build hype/interest and it did. but take it away and you solve many social problems and annoyances caused by AI with no loss to the upside of AI. no more cheating students in sch…

What is an ai enterprise tool?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#139

Post by hgoel »

As usual, I find the AI-related discussion here to be hopelessly hysterical and conspiratorial. I get the impression that a large chunk of people have only read the title and assumed Anthropic is referring to recursive self-improvement in the runaway singularity sense.

One of the examples they provide, of giving Claude the task of training a small AI model, then asking it to improve certain benchmarks, is essentially Karpathy's AutoResearch. This is already known to work. While calling it "self-improvement" is perhaps a stretch, it is describing a capability current gen AI has, that anyone can test and I have been using to great effect.

I disagree with their conclusion, I think this kind of self-improvement will hit an asymptote, where every subsequent model can only make smaller and smaller improvements.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#140

Post by bigbuppo »

TimMeade wrote: post #116
andai wrote: post #103

Earlier quoted context omitted.

Try 64K! https://en.wikipedia.org/wiki/Turbo_Pascal Also remember when XP was super bloated cause it needed 64MB?

I loved Turbo Pascal....

I loved XP. My laptop had 256MB of RAM.
Post reply on HN