Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

Post reply on HN
Print view View original

721–730 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#721

Post by TheRoque »

verdverm wrote: post #607
TheRoque wrote: post #397

Earlier quoted context omitted.

So with LLM outputting average code, and people using LLM more and more, I guess the average code will become worse over time ?

There is a belief that everyone is just taking whatever the LLM (really agents now) outputs. This is not the case anywhere I work. We use human oversight to have it iteratively improve the code. The average quality is going up.

Do you have some metrics to back this up ? Because from what I can see with my own eyes, outages everywhere, security holes everywhere too, doesn't seem that things are improving..

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#722

Post by tim333 »

streb-lo wrote: post #696
ivraatiems wrote: post #466

Whether or not Anthropic is right about what AI can accomplish, whether these performance gains are real or not, their moral stance here is absolutely hideous to me. "We must blast forwards into making this dangerous thing because if we don't, someone else surely will," is a coward's argument. If you believe it is dangerous, you should be dedicating yourself to STOPPING others from making it, not making it first! The…

Disarmament failed though? Global zero initiatives for nuclear weapons stalled out exactly because the risk of someone else cheating is too great. If everyone gets rid of their nuclear weapons and then someone cheats and creates them in secret they can use their nuclear weapons to prevent anyone else from catching up.

Also Ukraine is not a great advert for giving up your nukes.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#723

Post by ElProlactin »

wordpad wrote: post #717
cyanydeez wrote: post #648

Earlier quoted context omitted.

theres also no evidence that any of the manual labor will benefit. we are nowhere near the type of scifi utopia that gives us replicator food. aside from capitalism moving money up and living condotions down, AI is going to accelerate the gap between rich and everyone else.

Starvation is already not a thing anymore.

Really?

https://www.ers.usda.gov/topics/food-nutrition-assistance/fo...

And this is in the wealthiest country in the world.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#724

Post by megous »

skydhash wrote: post #660
megous wrote: post #653

Earlier quoted context omitted.

No. Fetching pages from remote server will just make the client wait for I/O. That takes 0 CPU load and if the server can't respond at 60fps, lowered redrawing frequency would mean even less CPU load from the terminal redrawing itself. This does not explain 100% CPU load these harnesses sometimes exhibit.

If it’s localhost, then it’s just the cpu doing stuff as localhost is a pseudodevice.

Localhost is irrelevant.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#725

Post by hazbot »

NackerHughes wrote: post #719
wordpad wrote: post #717

Earlier quoted context omitted.

Starvation is already not a thing anymore.

Then why are people starving?

The generous interpretation of the OPs comment it was gentle hyperbole but directionally correct relative to the not so distant past.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#726

Post by aroman »

JohnMakin wrote: post #682
aroman wrote: post #449

Earlier quoted context omitted.

Presumably the bottleneck is not software correctness... even true AGI change the laws of physics (or make datacenters appear out of thin air) ...

physics has nothing to do with the reliability of a service, or login outages.

physical reality - finite supply of limited resources whose demand exceeds supply - has everything to do with the reliability of a service

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#727

Post by verdverm »

TheRoque wrote: post #721
verdverm wrote: post #607

Earlier quoted context omitted.

There is a belief that everyone is just taking whatever the LLM (really agents now) outputs. This is not the case anywhere I work. We use human oversight to have it iteratively improve the code. The average quality is going up.

Do you have some metrics to back this up ? Because from what I can see with my own eyes, outages everywhere, security holes everywhere too, doesn't seem that things are improving..

There are insufficient metrics for both directions, and while you can find evidence to support either position, this discounts two things

1. Things are evolving. The models, and especially the harnesses, are getting better. There was an inflection point at the end of last year, so anything before that is no longer relevant to the discussion. Probably anything before now, since we've had about 6 months with real agentic engineering and things are starting to become clearer.

2. Application and effectiveness is not equally distributed. This is the newest and most significant technology humans have created. We are still building and figuring it out. Some people are better at it, some people use it rather unwisely.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#728

Post by stevenhuang »

jameson wrote: post #535

I don't quite understand the intent of such article other than to promote themselves given an odd timing that the company is planning on going public, so I can only conclude that this is just part of the IPO roadshow. LLMs certainly have made significant changes to our lives, but I haven't yet to see any extraordinary improvement it brought to me which makes me skeptical about their claims. _if_ it solves many of our…

It starts somewhere, like with this announcement.

I'm not sure why this is so difficult for you to understand.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#729

Post by sothatsit »

DanHulton wrote: post #641
sothatsit wrote: post #374

Earlier quoted context omitted.

Maybe my bar for what constitutes a breakthrough is lower than other people's, but all of these seem like breakthroughs to me: NLP as a field saw huge shifts. NLP tasks that used to be complex and inaccurate can now be setup very easily and quickly using structured outputs from LLMs, often with greater accuracy. A small charity I help with has now been able to build their own website to manage their day-to-day operat…

> ChatGPT has 1 billion MAU. People are now getting life advice, financial advice, and mental health help from chatbots at a scale and cost that no human support network could match. That's terrifying. You realize that's terrifying, right?

Definitely, it is quite an extreme change. But the upsides of better access to support and advice are huge, even if the potential downsides are scary as well. This feels like one area where we need better transparency and regulation due to how much ChatGPT and others can affect people who listen to them.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#730

Post by throwway120385 »

icepush wrote: post #496
throwway120385 wrote: post #358

Earlier quoted context omitted.

Or you could... open the door and look inside.

Put a servo on the door and a camera on the front. Train a vision model to recognize when your eyes are looking at the door and automatically open it for you. Another camera inside will detect when you are done and close it.

Think of all the gaze and marketing data we can extract and sell to third parties!
Post reply on HN