Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

Post reply on HN
Print view View original

301–310 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#301

Post by 0x53 »

aleqs wrote: post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

They also don’t have…a login page with authentication . To access the console you get an email link. No passkeys, passwords, 2fa, just an email.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#302

Post by signatoremo »

sensanaty wrote: post #254
qsort wrote: post #118

Earlier quoted context omitted.

Look, I've never been someone who mindlessly hypes AI companies, as a matter of fact I think they have serious leadership problems across the board, but you people are straw-manning them so badly it actually makes me sympathize with them. They aren't saying they have fully automated luxury AGI, they specifically list the ways models fall short of that bar and caution against people taking the 8x figure as the actual…

> At the same time they recognize that 80% of new code is now Al-authored I can setup a loop that will write a trillion lines of code automatically, how much of it is actually useful? Or are we back to counting LoC because there's no other metric for these systems that anyone can rely on?

I could write a bash script that copies a codebase repeatedly in the pre-AI past as well, but I didn't do that because I wasn't stupid. More than 80% of my code is now AI-generated, and trust me I'm still not stupid. It was 0% only a year ago.

Who says LoC is the only metric we should rely on? A software product should first and foremost meet user requirements, functionality and performance. Judging from the sensational rise of Anthropic's user base and revenue I think we can safely says they're in that ball pack.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#303

Post by Jtarii »

asdfman123 wrote: post #186
overgard wrote: post #173

So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.

I think that's a valid point. You could very well be right. But we're discussing whether we should close the barn door while the horse is three miles down the road.

It's more like if the horse was lazily moving in the general direction of the wide open barn door and we are all sitting around discussing if we should close the door or just gamble that it's just going to lay down on the hay pile.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#304

Post by comex »

replwoacause wrote: post #154
airstrike wrote: post #112

Earlier quoted context omitted.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

Why the hell does it need to be so complex? People have been making TUIs for decades. Did we need a small game engine to run claude code?

It doesn’t need to be that complex, but it can be that complex without being slow. Claude Code’s interface is extremely simple. It has tons and tons of headroom to tack on performance overhead without it being noticeable at all. You just have to not do dumb things like redraw the entire UI every time a spinner spins.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#305

Post by joshuamcginnis »

wild_egg wrote: post #289
pizlonator wrote: post #282

What I can’t get over is that there have been exactly zero software breakthroughs since vibe coding started, other than vibe coding itself. Claude is amazing, that’s true. But if it was as amazing as this article implies, I’d expect some breakthrough outside of AI itself. Rewriting a Zig program in unsafe Rust? Not a breakthrough. Finding a bunch of security vulns? Maybe that’s sort of a breakthrough though it’s unde…

What does a breakthrough look like?

Massive productivity gains.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#306

Post by fdsajfkldsfklds »

drtz wrote: post #293
pizlonator wrote: post #282

What I can’t get over is that there have been exactly zero software breakthroughs since vibe coding started, other than vibe coding itself. Claude is amazing, that’s true. But if it was as amazing as this article implies, I’d expect some breakthrough outside of AI itself. Rewriting a Zig program in unsafe Rust? Not a breakthrough. Finding a bunch of security vulns? Maybe that’s sort of a breakthrough though it’s unde…

Maybe I'm looking through rose colored glasses, but software that writes itself seems like a pretty big breakthrough to me.

Strictly speaking, it's modifying itself. Although it would be an interesting challenge - can an llm create a new llm from scratch?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#307

Post by quickthrowman »

aagha wrote: post #70
aleqs wrote: post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

And don't forget that they have BILLIONS of dollars and can't figure out how to get a decent support or public communications system setup.

It’s much cheaper to not offer any support than to offer support. It’s intentional.

It’s important to keep in mind that the less money a company spends, the more profit they make when analyzing their operations.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#308

Post by folkrav »

tokioyoyo wrote: post #133
mweidner wrote: post #131

Earlier quoted context omitted.

Is the idea to keep the world in balance via MAD? I could see that, though it's a dangerous gamble. From Richard Rhode's "The Making of the Atomic Bomb", I got the impression that most scientists involved thought they could manage a US or UN monopoly on nukes after the war. General Groves attempted to buy up all of the world's uranium ore. Unfortunately, it is only high grade ore that is rare; many countries have low…

Again quite arguable, but this is the real life scenario we’re living in. Nukes have made it hard to impossible for super major powers to go in direct conflict with each other.

Except it's pretty well documented (and this is total conjecture, but if you ask me, there are probably are a bunch of undisclosed cases) to have had a good amount of close calls. With the fire-on-warning stance many powers have, it doesn't take an attack, but just enough of the appearance of it to trigger a response.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#309

Post by f311a »

PunchyHamster wrote: post #243
airstrike wrote: post #112

Earlier quoted context omitted.

This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".

Well it runs on something they didn't design (Electron) using GUI library they didn't design (React) For company with that much AI you'd think if it was actually good, doing that part in fast and performant way would be "easy"

It runs in a terminal, it’s not electron

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#310

Post by docheinestages »

> We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology.

Elon, is that you? [1]

[1] https://www.theguardian.com/technology/2023/mar/31/ai-resear...

Post reply on HN