Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

351–360 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#351
"If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing. But if a slowdown simply lets the least cautious actors catch up technologically, it could leave everyone less safe."

How convenient for investors. They talk like they're a nonprofit instead of a VC-backed business chasing an IPO.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#352
post #26

> If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing Even Anthropic wants to Pause AI now. There must really be not much time left for "edging". Please write to your lawmakers, no matter whether you are in the US, Europe, China, or elsewhere. Only an international agreement between gov…

They don't, they just pretend they do.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#353
This reads like marketing fluff, but I am reminded of John von Neumann's "Theory of Self-Reproducing Automata"; that the very first people who worked on deductive machines immediately started thinking about machines building themselves, and what the rules of that would look like. I am not surprised that during the inductive revolution we are having similar thoughts.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#354

So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.

Too late for that. In any case firms that get too powerful can be nationalised.

In America?

Probably a better chance the firm privatizes the government.

In fact we seem to be firing government employees and dismantling government institutions as much as possible.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#355
post #293

What I can’t get over is that there have been exactly zero software breakthroughs since vibe coding started, other than vibe coding itself. Claude is amazing, that’s true. But if it was as amazing as this article implies, I’d expect some breakthrough outside of AI itself. Rewriting a Zig program in unsafe Rust? Not a breakthrough. Finding a bunch of security vulns? Maybe that’s sort of a breakthrough though it’s unde…

Maybe I'm looking through rose colored glasses, but software that writes itself seems like a pretty big breakthrough to me.

Which is funny because people have been using LISP for that since 1960.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#356

I am 64 years old, perhaps the progress could be directed to enhance living conditions and allowing people to live longer and better, that should be just a better result. Perhaps a pile of millions lines of code with hiding bugs that nobody can detect is not inspiring. But perhaps LLMs are going to be used to make a plot: How to avoid other countries to make progress, maintain them in poverty, or destroy their source…

I'm 44 years old and this era looks like a lot of fun. I've seen humans pile up millions of lines of code and hiding bugs that nobody can detect. I've seen humans make collective political decisions that have disenfranchised others and kept them in poverty. I don't get why everyone makes criticisms at this tech that the human race are also guilty of.

Best thing about this era is that I don't have to personally read millions of lines of code to find all the bugs.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#357

Anthropic has finally come around to what others have already realized far sooner. Little time left now. Notice how shallow the arguments and consistently wrong the AGI naysayers have been year after year. https://intelligence.org/agi-ruin/

Can you explain?

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#358

Earlier quoted context omitted.

It's product bloat. It's not recognizing that they are just one building block that should do one thing well, like tmux. You don't need a computer display on your fridge for the same reason, but Anthropic think you do. You should see virtual ice getting created and they should correspond to the actual ice behind the door - think of how amazing that is! And it's not even completely a bad idea. make it claude-code-reac…

I love the idea of installing high resolution cameras in the fridge to monitor the ice maker to feed into a vision model that renders digital ice to the exact position of the real ice on the fridge’s giant screen

Or you could... open the door and look inside.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#359
post #40

Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…

Well, people keep throwing money at them, including you and investors. So why would they care? It hasn't annoyed you or a large enough portion of users enough to move off their service - because there isn't a better alternative.
Post reply on HN