Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

471–480 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#471

Earlier quoted context omitted.

By that interpretation, neither the harness nor the LLM is the AI. The computer (or system of computers) taken as a whole is the AI. You can't remove any piece and still have an intelligent system.

Does this extend to power generation then, too?

Sure, why not. When you plug a device into the power network, it becomes one big system.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#472
post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

Better doesn't mean perfect.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#473
post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

This is weird to me because i am using claude code 10+ hours/day 7 days a week, usually multiple sessions, and run into api errors maybe in 1 or 2 sessions per week. And about..2 major outages of 10-20min in the last month. Not terrible and nowhere near what you are reporting. Therefore I dont believe you, because you dont even couch this in terms of it being something that seems particular to you or your region. Obvious dishonestly is fairly bad of you.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#474
post #263

Earlier quoted context omitted.

You can do that. But I'm telling you, in tech (and enterprise shops I've worked at too) they don't care. I'm using the internal Google tools and it's helping me write code much faster too, but it still takes time. I could make the CLI tool I work on faster, but no one cares except the end users, and their minor concerns have no impact on our internal politics. At the end of the day you have to do what you're paid to…

In other words, performance is almost always an afterthought.

Make it work, make it nice, make it fast.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#475
post #262

Earlier quoted context omitted.

The point I am making is the article you are responding to is marketing hype and that they are lying. Their engineers, I am fairly sure, are doing engineering. At least to the point Anthropic's interview process is trying to filter for people with engineering skills, not "how do you best leverage AI to make more AI" skills like this seems to imply.

You seem to have taken offense on behalf of the people working there. But I'm not attacking them nor seriously questioning their abilties/qualifications/performance. The slight reference I made to such was in an exclusive rhetorical device -- the situation presented cannot be, unless something unbelievable is occurring. It's the organisation, its culture, the greater culture surrounding it, and the marketing that I h…

I’ve not taken offense at anything - am supplying more information to supplement your post. if it’s not clear, I don’t really disagree, other than at their salary bands and stock comp I’m not sure I’d be taking big issue with press releases like this.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#476
post #304

Earlier quoted context omitted.

It doesn’t need to be that complex, but it can be that complex without being slow. Claude Code’s interface is extremely simple. It has tons and tons of headroom to tack on performance overhead without it being noticeable at all. You just have to not do dumb things like redraw the entire UI every time a spinner spins.

"We made our app chew up so many unnecessary resources that we can use even more resources in the future, and no one will notice" is not the strongest engineering idea I've ever heard.

It's like when Bill Gates tried to guess grocery prices. "How much memory does a regular computer have? I don't know, 50 GB? Like a small EC2?"

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#477
post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

This comment is a good example of the double standard laymen have about AI usage: If you use AI, then AI must be expected to solve all problems, even problems that affect everyone like infra scaling. And if perfection isn’t delivered, then of course it wasn’t: you used AI and AI sucks.

Ah, excuse me, I didn’t realize I was a mere layman.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#478

Earlier quoted context omitted.

> For each frame our pipeline constructs a scene graph with React then > -> layouts elements > -> rasterizes them to a 2d screen > -> diffs that against the previous screen > -> finally uses the diff to generate ANSI sequences to draw Yup. Overengineering.

This is a decades-old design pattern when CPU >> IO. Emacs has been doing just that since the 80s, when people were complaining about "Eight Megs And Constantly Swapping". See "redisplay" [1] This minimizes screen flash. You can't rely on terminals doing double-buffering. [1] https://github.com/emacs-mirror/emacs/blob/c29071587c64efb30... or a more user-friendly overview, Daniel Colascione's seminal "Buttery Smooth E…

Even with that, 1G of RAM usage is still not justified.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#479
post #318

Earlier quoted context omitted.

Strictly speaking, it's modifying itself. Although it would be an interesting challenge - can an llm create a new llm from scratch?

No, it probably can't during our lifetime at least—but it can sure modify itself to avoid antivirus detection, which is _just swell_.

why do you think so? they provide some evidence of this in the article, but there have been several improvements in e.g. nanogpt-speedrun or openai parameter golf made by AIs

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#480

Earlier quoted context omitted.

Maybe my bar for what constitutes a breakthrough is lower than other people's, but all of these seem like breakthroughs to me: NLP as a field saw huge shifts. NLP tasks that used to be complex and inaccurate can now be setup very easily and quickly using structured outputs from LLMs, often with greater accuracy. A small charity I help with has now been able to build their own website to manage their day-to-day operat…

> ChatGPT has 1 billion MAU. People are now getting life advice, financial advice, and mental health help from chatbots Personally not the kind of breakthrough I'm psyched about

Yeah, the thing that worries me is that an LLM can be guided to agree with any premise and will rarely ever take a hard stance.
Post reply on HN