Claude Code: An Agentic cleanroom analysis • Hacker News Board

Re: Claude Code: An Agentic cleanroom analysis

#11

Post by triyambakam » Sun, Jun 01, 2025, 10:22 PM UTC

rane wrote: post #7

triyambakam wrote: post #3

Claude Code with Sonnet 4 is so good I've stopped using Aider. This has been hugely productive. I've been able to write agents that Claude Code can spawn and call out to for other models, even.

Have you been able to interface Claude Code with Gemini 2.5 Pro? I'm finding that Gemini 2.5 Pro is still better at solving certain problems and architecture and it would be great to be able to consult directly in CC.

Well a quick hack is to tell Claude Code to make "AI!" comments in the code which Aider can be configured to watch for, then Gemini 2.5 Pro can do those tasks. Yes I really like Gemini still too

Re: Claude Code: An Agentic cleanroom analysis

#12

Post by owebmaster » Sun, Jun 01, 2025, 10:23 PM UTC

I have nothing against LLM-generated content. But when publishing, make sure the content is displayed correctly and that it is enjoyable to read.

Re: Claude Code: An Agentic cleanroom analysis

#13

Post by Aurornis » Sun, Jun 01, 2025, 10:24 PM UTC

flipthefrog wrote: post #8

eric-burel wrote: post #2

[flagged]

Light green text on light brown background is pretty ridiculous. I gave up after 30 seconds

FYI I don’t see light green text. Website looks fine to me on mobile and desktop. Maybe something wrong on your browser end?

Re: Claude Code: An Agentic cleanroom analysis

#14

Post by __mharrison__ » Sun, Jun 01, 2025, 10:32 PM UTC

triyambakam wrote: post #3

Claude Code with Sonnet 4 is so good I've stopped using Aider. This has been hugely productive. I've been able to write agents that Claude Code can spawn and call out to for other models, even.

What does it give you that enabling Sonnet as a backend for Aider doesn't?

Re: Claude Code: An Agentic cleanroom analysis

#15

Post by cedws » Sun, Jun 01, 2025, 10:33 PM UTC

triyambakam wrote: post #3

Claude Code with Sonnet 4 is so good I've stopped using Aider. This has been hugely productive. I've been able to write agents that Claude Code can spawn and call out to for other models, even.

Could you briefly explain your workflow? I use Zed’s agent mode and I don’t really understand how people are doing it purely through the CLI. How do you get a decent workflow where you can approve individual hunks? Aren’t you missing out on LSP help doing it in the CLI?

Re: Claude Code: An Agentic cleanroom analysis

#16

Post by doctoboggan » Sun, Jun 01, 2025, 10:36 PM UTC

mholm wrote: post #10

InGoldAndGreen wrote: post #6

The "LLMs perspective" section is hiding at the end of this notion is a literal goldmine

It's sure phrased like one, but I'd be careful to attribute LLM thought process to what it says it's thinking. LLMs are experts at working backwards to justify why they came to an answer, even when it's entirely fabricated

> even when it's entirely fabricated

I would go further and say it's _always_ fabricated. LLMs are no better able to explain their inner workings than you are able to explain which neurons are firing for a particular thought in your head.

Note, this isn't a statement on the usefulness of LLMs, just their capability. An LLM may eventually be given a tool to enable it to introspect, but IMO its not natively possible with the LLM architectures today.

Re: Claude Code: An Agentic cleanroom analysis

#17

Post by roxolotl » Sun, Jun 01, 2025, 10:38 PM UTC

demarq wrote: post #9

InGoldAndGreen wrote: post #6

The "LLMs perspective" section is hiding at the end of this notion is a literal goldmine

It's the best thing I've read from an LLM! It sounds a lot like like the Murderbot character in the AppleTV show!

Right… because these things are trained on sci-fi and so when asked to describe an internal monologue they create text that reads like an internal monologue from a sci-fi character.

Maybe there’s genuine sentience there, maybe not. Maybe that text explains what’s happening, maybe not.

Re: Claude Code: An Agentic cleanroom analysis

#18

Post by demarq » Sun, Jun 01, 2025, 10:47 PM UTC

roxolotl wrote: post #17

demarq wrote: post #9

Earlier quoted context omitted.

It's the best thing I've read from an LLM! It sounds a lot like like the Murderbot character in the AppleTV show!

Right… because these things are trained on sci-fi and so when asked to describe an internal monologue they create text that reads like an internal monologue from a sci-fi character. Maybe there’s genuine sentience there, maybe not. Maybe that text explains what’s happening, maybe not.

> Maybe that text explains what’s happening, maybe not

It would have been cool to see what prompt was used for that page!

Re: Claude Code: An Agentic cleanroom analysis

#19

Post by sonu27 » Sun, Jun 01, 2025, 10:48 PM UTC

[flagged]

Re: Claude Code: An Agentic cleanroom analysis

#20

Post by girvo » Sun, Jun 01, 2025, 10:50 PM UTC

fullstackchris wrote: post #5

also, i will say, (if we can trust the findings in these notes are relatively accurate of the real implementation) is a PERFECT example of the real level of complexity used in cutting edge configuration of using LLM... its not just some complex fancy prompt you give to a model in a chat window... there is so much important stuff happening behind the scenes... though i suppose the people who complain about LLMs halluc…

> or, it could be their architecture / code is so poorly written and poorly organized that even the LLM itself struggles to modify it properly

You wrote this like this is some rare occurrence, and not a description of a bulk of the production code that exists today, even at high level tech companies.