Live data from Hacker News

The new rules of context engineering for Claude 5 generation models

claude.com

321–330 of 434 posts

Re: The new rules of context engineering for Claude 5 generation models

#321

Earlier quoted context omitted.

This is true and it's barely even debatable. Whatever exact role language plays in our thought processes, it is most definitely nonzero. It's why I think "LLMs are only fancy autocorrect" style takes are really underselling how wild it is that we've, in a roundabout way, sort of crystallized a bit of the human thought process in a way that is genuinely useful for a lot of tasks. Linguistic Relativity — John Lucy http…

> sort of crystallized a bit of the human thought process a) LLMs don't think. They predict a most probable sequence of language tokens. Huge difference there. b) Whatever LLMs do doesn't model human behavior whatsoever. LLMs are basically very fancy logistic regressors. I.e., it's a mathematical abstraction first and foremost.

The (or a) current neuroscience models of the brain are that its main job is to predict how the body should be responding in the near future. Obviously a lot more complex network nodes than an LLM, but prediction is clearly tied up with thought in some way.

I don’t find LLMs to be very good independent thinkers, but I wouldn’t over sell our own mentation either - it clearly arises from a large number of simpler entities.

The more significant difference is that the LLM is stuck with language which is clearly an emergent and secondary capability of our own thinking. We can formulate words to explain things, but we also can look at two volumes and feel what it means that one is larger than the other. Raise a toddler and you can see the progression from not understanding, repeated experiments, muscle memory and finally to conscious point for reasoning.

Re: The new rules of context engineering for Claude 5 generation models

#322

This kind of stuff just makes me think nobody has any clue how these things work. Why do I need a system prompt at all? Why do I need another black box AIs to review the code of the black box AI why can’t these things get code right the first time. Why is the best “coding model” in the world still making up APIs that don’t exist and do seemingly random unreleased changes that it wasn’t prompted for. Why do these mode…

> Why do I need a system prompt at all?

That's like asking why you need employee onboarding.

You could have Stephen Freaking Hawking and he still wouldn't know what you specifically want.

> Why do I need another black box AIs to review the code of the black box AI why can’t these things get code right the first time.

That's like asking why you need code reviews.

Thinking about it from an antagonistic perspective is useful. You can combine it into all the "same system" if helpful.

> Why is the best “coding model” in the world still making up APIs that don’t exist and do seemingly random unreleased changes that it wasn’t prompted for.

Because....it still isn't perfect?

> Why do these models (supposedly) keep getting “better” (on benchmarks) but continue to degrade in output quality

That is disconnected from reality.

Re: The new rules of context engineering for Claude 5 generation models

#323

Earlier quoted context omitted.

I think you're conflating different things. Many people do not have an internal 'narrator'. I am one. I don't have a voice in my head saying words, ever. I do definitely have something like a playback of other people saying things, though. Words are still in there in the form of recall, they are just not part of the executive layer in a way I have access to.

What about when you're reading? You don't have a voice in your head saying the words?

Only if it is a very hard text that I have to move slowly thru. For normal reading, no not at all. If I am trying to read something faster than is comfortable, I will periodically emphasize the thing, the idea, behind a key word, so I am more likely to remember it at the useful time. Not verbal and there are many many times when I can describe the thing but not recall the normal word. Like the flat thing with keys in it instead of keyboard. Or even weird quasi-synonyms that serve to muddy the waters as far as sharing my thoughts with others goes.

Re: The new rules of context engineering for Claude 5 generation models

#324
post #179

Earlier quoted context omitted.

"There is a depth of thought untouched by words, and deeper still a depth of formless feeling untouched by thought." - Rilke Your assertion that we don't think in language is questionable. It runs counter to the lived experience of developing thoughts through writing ("writing isn't capturing thinking -- it is thinking"). I believe there is more to thought than language alone, but I also feel quite sure that language…

Just because you can think through writing doesn't mean language is the essence of thought itself.

The virtue of writing is it makes it harder to fool yourself that you have all the important links addressed in your construction/argument/proposal.

Re: The new rules of context engineering for Claude 5 generation models

#326

This kind of stuff just makes me think nobody has any clue how these things work. Why do I need a system prompt at all? Why do I need another black box AIs to review the code of the black box AI why can’t these things get code right the first time. Why is the best “coding model” in the world still making up APIs that don’t exist and do seemingly random unreleased changes that it wasn’t prompted for. Why do these mode…

Lately, I've been having less and less success using the models for work. Simple things like:

'write this in a separate file' (writes it in the same file)

'format this aiming for 5 LoC' (emits newline after every comma, resulting in 17 LoC)

'include 5 warmup steps before you measure runtime' (omits it completely and apologizes after I point it out)

I wouldn't be as opposed to using the models if they weren't as unreliable. I still use them a lot, but it's a very frustrating experience.

Re: The new rules of context engineering for Claude 5 generation models

#328

Earlier quoted context omitted.

The llm will figure it out when it relooks at the file.

This feels like a good place for tighter integration between editors and agents. The editor could notify the agent of user authored changes.

This is very trivial to implement in any serious tool/workflow. I have a version of it in my pi nvim setup.

Re: The new rules of context engineering for Claude 5 generation models

#329

Earlier quoted context omitted.

I’m ashamed to admit that I once suddenly realized what I had done: I asked the LLM to rename a variable. It took it some minutes or so. With IDE by hand it would have been seconds.

The annoying issue sometimes is that while it is faster to do it yourself, the context of the LLM is not updated. So now you have you to mention that and mentioning it is a bit fuzzier sometimes than the LLM simply doing the rename itself, so the context stays up to date.

[deleted]

Re: The new rules of context engineering for Claude 5 generation models

#330

Earlier quoted context omitted.

I’m ashamed to admit that I once suddenly realized what I had done: I asked the LLM to rename a variable. It took it some minutes or so. With IDE by hand it would have been seconds.

The other day I asked it to update a handful of files using a new pattern I built. It was tedious work, and probably would have taken me 10 minutes, but I figure why not just let Claude do it. Well, it spun up multiple agents, each taking a different approach (one writing a Perl script, the other just doing fancy regex, etc) and 30 minutes later had the result. Granted, it wasn't my 30 minutes it was using, but it fe…

I'm hard pressed to believe it didn't also take 10 minutes of your time checking in and head shaking and reviewing and testing.
Post reply on HN