Earlier quoted context omitted.
By that interpretation, neither the harness nor the LLM is the AI. The computer (or system of computers) taken as a whole is the AI. You can't remove any piece and still have an intelligent system.
Does this extend to power generation then, too?
When AI Builds Itself: Our progress toward recursive self-improvement
471–480 of 738 posts
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#472Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#473Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#474Earlier quoted context omitted.
You can do that. But I'm telling you, in tech (and enterprise shops I've worked at too) they don't care. I'm using the internal Google tools and it's helping me write code much faster too, but it still takes time. I could make the CLI tool I work on faster, but no one cares except the end users, and their minor concerns have no impact on our internal politics. At the end of the day you have to do what you're paid to…
In other words, performance is almost always an afterthought.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#475Earlier quoted context omitted.
The point I am making is the article you are responding to is marketing hype and that they are lying. Their engineers, I am fairly sure, are doing engineering. At least to the point Anthropic's interview process is trying to filter for people with engineering skills, not "how do you best leverage AI to make more AI" skills like this seems to imply.
You seem to have taken offense on behalf of the people working there. But I'm not attacking them nor seriously questioning their abilties/qualifications/performance. The slight reference I made to such was in an exclusive rhetorical device -- the situation presented cannot be, unless something unbelievable is occurring. It's the organisation, its culture, the greater culture surrounding it, and the marketing that I h…
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#476Earlier quoted context omitted.
It doesn’t need to be that complex, but it can be that complex without being slow. Claude Code’s interface is extremely simple. It has tons and tons of headroom to tack on performance overhead without it being noticeable at all. You just have to not do dumb things like redraw the entire UI every time a spinner spins.
"We made our app chew up so many unnecessary resources that we can use even more resources in the future, and no one will notice" is not the strongest engineering idea I've ever heard.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#477Okay, so anthropic has amazing AI which supposedly writes most of their code and can continuously improve... meanwhile they have outages on a regular basis, and any kind of long-running work will now consistently hit 'API Error: Server is temporarily limiting requests'. Not sure of this is intentional to force a reduction of token usage, but at this point I need to build around these throttling limits and outages wit…
This comment is a good example of the double standard laymen have about AI usage: If you use AI, then AI must be expected to solve all problems, even problems that affect everyone like infra scaling. And if perfection isn’t delivered, then of course it wasn’t: you used AI and AI sucks.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#478Earlier quoted context omitted.
> For each frame our pipeline constructs a scene graph with React then > -> layouts elements > -> rasterizes them to a 2d screen > -> diffs that against the previous screen > -> finally uses the diff to generate ANSI sequences to draw Yup. Overengineering.
This is a decades-old design pattern when CPU >> IO. Emacs has been doing just that since the 80s, when people were complaining about "Eight Megs And Constantly Swapping". See "redisplay" [1] This minimizes screen flash. You can't rely on terminals doing double-buffering. [1] https://github.com/emacs-mirror/emacs/blob/c29071587c64efb30... or a more user-friendly overview, Daniel Colascione's seminal "Buttery Smooth E…
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#479Earlier quoted context omitted.
Strictly speaking, it's modifying itself. Although it would be an interesting challenge - can an llm create a new llm from scratch?
No, it probably can't during our lifetime at least—but it can sure modify itself to avoid antivirus detection, which is _just swell_.
Re: When AI Builds Itself: Our progress toward recursive self-improvement
#480Earlier quoted context omitted.
Maybe my bar for what constitutes a breakthrough is lower than other people's, but all of these seem like breakthroughs to me: NLP as a field saw huge shifts. NLP tasks that used to be complex and inaccurate can now be setup very easily and quickly using structured outputs from LLMs, often with greater accuracy. A small charity I help with has now been able to build their own website to manage their day-to-day operat…
> ChatGPT has 1 billion MAU. People are now getting life advice, financial advice, and mental health help from chatbots Personally not the kind of breakthrough I'm psyched about