[flagged]
The new rules of context engineering for Claude 5 generation models
281–290 of 434 posts
Re: The new rules of context engineering for Claude 5 generation models
#282Re: The new rules of context engineering for Claude 5 generation models
#283Earlier quoted context omitted.
It's language and speech patterns that seem designed to trick readers into believing that claims are correct, even when the claims aren't based on anything and are possibly wrong. It was rewarded for this during training for some reason. Alternative theory: The LLMs only way to "think" about abstract concepts is through language, and this leaks into into conversation it has with humans. But humans generally prefer to…
"There is a depth of thought untouched by words, and deeper still a depth of formless feeling untouched by thought." - Rilke Your assertion that we don't think in language is questionable. It runs counter to the lived experience of developing thoughts through writing ("writing isn't capturing thinking -- it is thinking"). I believe there is more to thought than language alone, but I also feel quite sure that language…
Hand-waving assumptions drawn from narrow subjective experience without awareness of the profound and contradictory results that have come from scientific study of consciousness and causality.
Re: The new rules of context engineering for Claude 5 generation models
#284I assume there has been, but can anyone point me in the direction of some bench-marking where someone uses longer magic incantations vs just a really brief goal? I barely keep an agents file, and it seems to do fine in the end - perhaps I am missing something?
Re: The new rules of context engineering for Claude 5 generation models
#285Earlier quoted context omitted.
Language is a reductive and lossy serialization of "thought-stuff". Sometimes you need this information-shedding to clear your working memory to make room for more things. Sometimes it's literally just a way to communicate. You're turning something fuzzy into something discrete. E.g. "I'm feeling something. Is it anger? Yes, I'm angry." But in reality anger isn't just one thing. It's a cluster of infinite and varied…
Also there are emotions for which society has not developed words because it has a social tendency to deny them. OCD, ADHD and Tourettes, for example are driven by deep, complex, strange destructive emotional needs that are wordless and undescribed. They are reduced to “obsession”, “compulsion”, “urge”, “tic”, etc., words that essentially only describe the appearance of the outcomes to others, which are a completely…
To me, Alexithymia alone proves this.
Re: The new rules of context engineering for Claude 5 generation models
#286Earlier quoted context omitted.
You just lack (or lacked) introspection, nothing special. Many people claim to have no inner monologue. When pressed, it always comes out. Simply put, it's impossible to function as a human without it. But many people are not aware, and think it means something like "hearing actual voices".
I'm not sure. I think I had a reasonable amount of metacognition as a child. I remember being eight years old, and having a really cool idea but forgetting it. So I devised a plan to retrieve it. I'm just going to rewind time. I'm going to go back to doing what I was doing when I had that idea, and then it'll come back to me. And so I remembered that I had been fiddling with my seat belt when I had the idea. And so I…
> So I devised a plan to retrieve it. I'm just going to rewind time. I'm going to go back to doing what I was doing when I had that idea, and then it'll come back to me.
You narrated the ideas back. It's words and language. There is no hidden, unknown, layer of "thought".
Re: The new rules of context engineering for Claude 5 generation models
#287So this is cool. I recently asked Opus and Fable to "say hi" in Claude code. The "hi" cost roughly $0.50 for Opus and $1 for Fable, mostly due to the length of the system prompt. I'm eager to test the new version. If it's 80% shorter now, then saying hello should only cost Fable $0.20. Exciting times.
Do you know why they don't just cache the system prompt for everyone? It seems so wasteful not to.
Cynicism, but I’d say because they charge by the token for API users?
Re: The new rules of context engineering for Claude 5 generation models
#288"We need to move away from text files to something proprietary and lock-in our users, while we still have this moat."
Re: The new rules of context engineering for Claude 5 generation models
#289Earlier quoted context omitted.
It's language and speech patterns that seem designed to trick readers into believing that claims are correct, even when the claims aren't based on anything and are possibly wrong. It was rewarded for this during training for some reason. Alternative theory: The LLMs only way to "think" about abstract concepts is through language, and this leaks into into conversation it has with humans. But humans generally prefer to…
"There is a depth of thought untouched by words, and deeper still a depth of formless feeling untouched by thought." - Rilke Your assertion that we don't think in language is questionable. It runs counter to the lived experience of developing thoughts through writing ("writing isn't capturing thinking -- it is thinking"). I believe there is more to thought than language alone, but I also feel quite sure that language…
I'm not an expert but I saw Yann LeCun shared this recent Neuroscience article on his Facebook page commenting "I don't think in words. Animals don't think in words."
Evidence from formal logical reasoning reveals that the language of thought is not natural language
Re: The new rules of context engineering for Claude 5 generation models
#290We want more control, not less. This (among many others) is the reason I use GPT over Claude. It adheres very closely to your instructions and rules. You can build up your own workflows and systems as a result. Claude just does whatever it wants, regardless of what you tell it. It's a miserable experience. Claude is what you use when you want to one-shot a simple cookie-cutter product that has no nuance in it. A prod…
Weird take. I’ve used both and both were perfectly good at adhering to my instructions and guidelines.
Now I won’t touch Altman-related products, but I doubt the newer models from OpenAI are worlds better as you say? Claude is fine. It follows instructions well, can be taught to only look up code semantically, to use AST for editing, etc.
As an old dev, most of the harnesses and capable models are fine. Dunno what you’re complaining about.