Live data from Hacker News

When AI Builds Itself: Our progress toward recursive self-improvement

anthropic.com

41–50 of 738 posts

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#41
Anthropic is looking to IPO here soon. A key aspect of this is to prove profitability.

Shifting their focus from Training new models to instead serving inference, they would greatly reduce their spend. In fact this is something being reported on that they are already doing, which is the reason for their first ever profitable quarter.

Its awfully convenient that the company which has greatly reduced its spend on training is now asking for a slow down in this area.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#42
post #26

> If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing Even Anthropic wants to Pause AI now. There must really be not much time left for "edging". Please write to your lawmakers, no matter whether you are in the US, Europe, China, or elsewhere. Only an international agreement between gov…

That would be like trying to get every country to agree to give up nukes.

Or stop making more, and testing more, which we got the biggest countries to do, at least for a time.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#43
Anthropic has finally come around to what others have already realized far sooner. Little time left now. Notice how shallow the arguments and consistently wrong the AGI naysayers have been year after year.

https://intelligence.org/agi-ruin/

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#44

Earlier quoted context omitted.

Tear down or reinforce?

capital/ability to leverage labor is going to lose power

Let the ruling classes tremble at a Communistic revolution. The proletarians have nothing to lose but their chains. They have a world to win.

Workingmen of all countries unite!

Translation: hahahahahahahahahhahahaha but in your defense, I would give anything to be wrong.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#45
I have a claw that is instructed to make at least 500 pr per day. It uses Claude, Gemeni and openai and runs basically every few minutes. I use online forums for input for the claw. Moltbook, reddit etc. it's quite funny how it tries to improve itself. But to say it really creates a new skynet. Nah. Not at all. It's more a clutter of useless features or incomprehensible code restructuring.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#46

AI tech bro: Month 1 - 6 months to AGI Month 2 - We will Replace all jobs Month 3 - Okay maybe only the SWEs, programming is solved Month 4 - Announce model that is too dangerous to release Month 5 - Releases dangerous model Month 6 - This is it! We will replace AIs with more AIs (*secretly files for IPO) AI is here to stay, like it or not but it is not the solution to everything. If it is, what is Anthropic's moat?…

i'm waiting for the AI giants to realize that they are burning cash to run their consumer-facing chatbots and that they should kill those products to focus on their enterprise tools.

free chatgpt doesn't need to exist anymore. its job was to build hype/interest and it did.

but take it away and you solve many social problems and annoyances caused by AI with no loss to the upside of AI. no more cheating students in school. no more shitty linkedin posts. no more dangerous "therapy sessions" that give bad advice.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#47

> We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology. The Anthropic Institute will conduct research—in collaboration with many others—and take actions to help build the systems that a credible slowdown or pause would require. Interesting - they're commiting…

We should be skeptical of any major player that advocates for regulating their own industry. In practice, this just means increasing barriers to entry and making it harder to compete with them. In my mind we should be trying to push AI along the Linux trajectory. You have a free and open source product, developed by a decentralized team with a strong code of ethics, running on commodity hardware. There can still be t…

The regulation that is being argued for here is against pushing the frontier. Entering the market with say a new speech to text model is not subject to such regulation. What's needed is something qualitatively different from entry barriers, and of the frontier model companies at least Anthropic and deepmind seem to have enough self-awareness to speak about it. They are finding themselves in a race with possibly catastrophic outcome for humanity and would like to stop, but it needs internation cooperation on a level that no single company can provide.

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#49
post #21

Earlier quoted context omitted.

Hierarchies exist for a reason, take away the reason and the house of cards eventually collapses — but the house of cards is still a house. When it’s gone, we’re back to laws of the jungle. Be careful what you wish for IOW.

I think certain types of people with power, i.e. access to capital, will lose relevance. world will become more meritcratic with ai as leverage to the individual

Your analysis of the whole rise of AI is that people with access to capital will lose relevance???

So the most capital intensive industry we've ever created will put less power in the hands of those with capital?

I'm sorry, I have no idea how you came to that conclusion...

Re: When AI Builds Itself: Our progress toward recursive self-improvement

#50
post #34
post #26

> If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing Even Anthropic wants to Pause AI now. There must really be not much time left for "edging". Please write to your lawmakers, no matter whether you are in the US, Europe, China, or elsewhere. Only an international agreement between gov…

Whichever side I may stand on, pausing just seems unnatural? Life is movement.

And happiness is restraint.
Post reply on HN