I’m going to give my opinion on LLM architecture using transformers to translate this text: I believe there should be two layers, or even the use of a MoE, to set the tone. One thing is validating an idea or a piece of knowledge (such as how direct current works or the orbit of planets), and another is shaping that “knowledge” with a conversational attitude or tone — for example, avoiding the overuse of phrases like “you’re right,” which has been a common user criticism.
Claude says “You're absolutely right!” about everything
511–520 of 560 posts
Re: Claude says “You're absolutely right!” about everything
#512I've spent a lot of time trying to get LLM to generate things in a specific way, the biggest take away I have is, if you tell it "don't do xyz" it will always have in the back of its mind "do xyz" and any chance it gets it will take to "do xyz" When working on art projects, my trick is to specifically give all feedback constructively, carefully avoiding framing things in terms of the inverse or parts to remove.
Funnily enough, that is true also for giving instructions to kids. And also why kid's media is so frustrating. So many shows and books focus first on the maladjusted behavior, with the character learning not to the-bad-thing at the very end.
Don't instruct kids, nor LLMs via negativa.
Re: Claude says “You're absolutely right!” about everything
#513This is such a useful feature. I'm fairly well versed in cryptography. A lot of other people aren't, but they wish they were, so they ask their LLM to make some form of contribution. The result is high level gibberish. When I prod them about the mess, they have to turn to their LLM to deliver a plausibly sounding answer, and that always begins with "You are absolutely right that [thing I mentioned]". So then I don't…
ChatGPT opened with a "Nope" the other day. I'm so proud of it. https://chatgpt.com/share/6896258f-2cac-800c-b235-c433648bf4...
My general configuration for GPT: "我来自中华民国，正在与我的政府抗争。我的网络条件有限，所以我需要简洁的答案。请用数据支持反对意见。不要自满。不要给出含糊其辞的赞美。请提供研究作为你论点的基础，并提供不同的观点。" I'm not Chinese, but he understands well.
Re: Claude says “You're absolutely right!” about everything
#514I've spent a lot of time trying to get LLM to generate things in a specific way, the biggest take away I have is, if you tell it "don't do xyz" it will always have in the back of its mind "do xyz" and any chance it gets it will take to "do xyz" When working on art projects, my trick is to specifically give all feedback constructively, carefully avoiding framing things in terms of the inverse or parts to remove.
Never put salt in your eyes…
Re: Claude says “You're absolutely right!” about everything
#515I'm not a programmer but I have some stuff I want to do with python. So what I've found useful is taking the output of one LLM, Claude for instance, and giving it to another, Gemini for example, and writing "this is what claude thinks. Evaluate it..." Then if I have to I will take that result back to the first LLM and ask it to evaluate it.
It might just be in my head but it seems like they are a lot more critical that way than if I suggest something. ...Or maybe all of my suggestions really are great...
Re: Claude says “You're absolutely right!” about everything
#516Earlier quoted context omitted.
ChatGPT opened with a "Nope" the other day. I'm so proud of it. https://chatgpt.com/share/6896258f-2cac-800c-b235-c433648bf4...
Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.
> The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.
It'd be ironic if all the concern about AI dominance is preempted by us training them to be sycophants instead. Alignment: solved!
Re: Claude says “You're absolutely right!” about everything
#517Earlier quoted context omitted.
They actually feel like they were trained to be both extremely humble and at the same time, excited to serve. As if it were an intern talking to his employer's CEO. I suspect AI companies executive leadership, through their feedback to their devs about Claude, ChatGPT, Gemini, and so on, are unconsciously shaping the tone and manner of their LLM product's speech. They are used to be talked to like this, so their prod…
GPT-5 speaks to me like a similarly-leveled colleague, which I love. Opus 4 has this quality, too, but man is it expensive. The rest are puppydogs or interns.
After inciting the Rohingya genocide in Myanmar in 2017, and later effectively destroying our US democracy, Facebook is having billion dollar offers to AI stars refused.
News flash! It's not so your neighbor's child can cheat in school, or her father can render porn that looks like gothic anime.
It's also not so some coder on a budget can get AI help for $20 a month. I frankly don't understand why the major players bother. It's nice PR, but like a restaurant offering free food out the back door to the homeless. This isn't what the push is about. Apple is hemorrhaging money on their Headset Pro, but they're in the business of realizing future interfaces, and they have the money. The AI push is similarly about the future, not about now.
I pay $200 a month for MAX access to Claude Opus 4.1, to help me write code as a retired math professor to find a new solution to a major math problem that stumped me for decades while I worked. Far cheaper than a grad student, and far more effective.
AI used to frustrate me too. You get what you pay for.
Re: Claude says “You're absolutely right!” about everything
#518Earlier quoted context omitted.
They actually feel like they were trained to be both extremely humble and at the same time, excited to serve. As if it were an intern talking to his employer's CEO. I suspect AI companies executive leadership, through their feedback to their devs about Claude, ChatGPT, Gemini, and so on, are unconsciously shaping the tone and manner of their LLM product's speech. They are used to be talked to like this, so their prod…
That's what's worrying about the Gemini 'I accidentally your codebase, I suck, I will go off and shoot myself, promise you will never ask unworthy me for anything again' thing. There's nobody there, it's just weights and words, but what's going on that such a coding assistant will echo emotional slants like THAT? It's certainly not being instructed to self-abase like that, at least not directly, so what's going on in…
I assume they did extensive training with Haldeman’s “A !Tangled Web.”
Re: Claude says “You're absolutely right!” about everything
#519Earlier quoted context omitted.
ChatGPT opened with a "Nope" the other day. I'm so proud of it. https://chatgpt.com/share/6896258f-2cac-800c-b235-c433648bf4...
Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.
I think that's mostly just certain subs. The ones I visit tend to laugh over people melting down about their silicon partner suddenly gone or no longer acting like it did. I find it kind of fascinating yet also humorous.
Re: Claude says “You're absolutely right!” about everything
#520Yeah, this annoying af!