So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.
Skynet is 30 years late!
When AI Builds Itself: Our progress toward recursive self-improvement
241–250 of 738 posts
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#242So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#243Earlier quoted context omitted.
Infrastructure is a much harder problem. They can't even improve Claude Code, which eats 1GB+ of RAM. Meanwhile, my editor only consumes 80MB of RAM.
This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".
For company with that much AI you'd think if it was actually good, doing that part in fast and performant way would be "easy"
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#244labs have parallel speculative execution. they spawn hundreds of agent branches, validate them internally with AI judges and only show the user the successful result.
free users are using sequential single-turn generation. the model requires and waits for the human to debug, fix and re-prompt.
by forcing a human to act as validator. they are capturing high value correction trajectories (Bad Output --> Human fix). They are using your cognitive labour to train judge models and validator agents needed to automate the internal verification step, eventually closing the loop for fully autonomous recursive self-improvement.
human in the loop debugging isn't a bug; it's the necessary training signal for the self-validating agents required for exponential recursive self improvement. With new 'distilled judge' models landing in 2026, this article means that they might have gathered enough data. we might be in the final phase..
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#245Earlier quoted context omitted.
> For each frame our pipeline constructs a scene graph with React then -> layouts elements -> rasterizes them to a 2d screen -> diffs that against the previous screen -> finally uses the diff to generate ANSI sequences to draw That’s rather sickening.
So I’m wondering what ‘rasterizing’ literally means in this case. I imagine it’s just creating a 2D map of elements at a very low (probably character) resolution, then diffing that against the last generated map to come up with an optimal ANSI sequence to send to the terminal, would that be right? Seems like a cool puzzle to solve. I wonder what the engineering and organisation tradeoffs were that lead to it — does i…
If they're doing anything else, the word "rasterizing" is being misused.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#246Re: When AI Builds Itself: Our progress toward recursive self-improvement
#247Anthropic is looking to IPO here soon. A key aspect of this is to prove profitability. Shifting their focus from Training new models to instead serving inference, they would greatly reduce their spend. In fact this is something being reported on that they are already doing, which is the reason for their first ever profitable quarter. Its awfully convenient that the company which has greatly reduced its spend on train…
Maybe it is my poverty mindset that is holding me back, however, I can't imagine becoming an investor in any of the AI 'startups'.
There are plenty of pundits able to advise others on where to put their money, and sometimes there is everyone and their dog advising you to get into Bitcoin, gold or some other scheme. With alt-coins there were lots of people saying that you should get in, and plenty of naysayers. Yet I am not hearing anyone that uses AI professionally try to convince others to get into the AI IPOs coming up. Maybe the overall economic situation precludes it.
Hence my question, is anyone here planning to put their own hard-earned money into Anthropic (or the other AI 'start ups')?
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#248This is incredible.[0] Please, IPO now. File the paperwork. > To take just one example: today, Anthropic engineers on average ship 8x as much code per quarter as they did from 2021-2025. Do you have another example? Engineers don't ship [period] for no reason. So, either: - Those aren't engineers, or - they are literally dying of shame & embarrassment right now, or - you measured something that indicated that this wa…
Go look at open job listings at anthropic and the interview process. You aren’t allowed to use AI during coding assessments[0], or knowledge assessments, which suggests they very much do need and value hard skills and this is fluff. [0] - https://www.anthropic.com/candidate-ai-guidance
I'm responding to the article they wrote and published.
If I worked there I would be embarrassed to have it publicised that I have been comitting 8 times as much code as I used to without even attempting to justify it.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#249Earlier quoted context omitted.
This might explain it, in the opposite way it was meant to: https://fxtwitter.com/trq212/status/2014051501786931427 > Most people's mental model of Claude Code is that "it's just a TUI" but it should really be closer to "a small game engine".
> For each frame our pipeline constructs a scene graph with React then > -> layouts elements > -> rasterizes them to a 2d screen > -> diffs that against the previous screen > -> finally uses the diff to generate ANSI sequences to draw Yup. Overengineering.
It's not recognizing that they are just one building block that should do one thing well, like tmux.
You don't need a computer display on your fridge for the same reason, but Anthropic think you do. You should see virtual ice getting created and they should correspond to the actual ice behind the door - think of how amazing that is!
And it's not even completely a bad idea. make it claude-code-react-beauty of some way to take it off, it would be far more palatable.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#250I find any and all claims like this ridiculous from a company who can't build a terminal application that uses less than a gigabyte of RAM.