Live data from Hacker News

How to stop Claude from saying load-bearing

jola.dev

271–280 of 650 posts

Re: How to stop Claude from saying load-bearing

#271
post #213

Lots of people have their own voice and tend to prefer certain phrases. This has been the case for a long time and is generally not a big issue. Now LLMs come along and they also have their own phrasing preferences. But now it's a problem because what used to be personal preferences of a single person that manifests in 5000 words per day from one person tops, is now the bias of a single model multiplied x10,000,000,0…

I think it might be even worse. LLMs seem to get tragically stuck on certain patterns. Maybe it's partly because a pile of weights essentially always starts from scratch in the same condition, but even within a single conversation, it will literally just latch onto words and repeat them incessantly, to the point where it becomes annoying. So for example, current Claude models love "honest". They are always producing…

A fun example, always shake my head when I read it again: https://openai.com/index/where-the-goblins-came-from/

Re: How to stop Claude from saying load-bearing

#272

Earlier quoted context omitted.

Another one is "surface", like in "across all product surfaces". I've been in the field for 15 years and have never heard that particular usage before.

In my brief and abortive foray into education, I discovered that they friggin' love to use "surface" as a verb. As in: This activity surfaces an understanding of the turboencabulation principle for learners. Or somesuch. It's been a while, happily. Unless you're a submarine, "surface" is not a verb.

Idk. I've always used that verb with clients, usually when I notice either malfeasance or hidden behavior. Like: "I was checking our code for where a half cent of sales tax might be accidentally rounded down, and it surfaced something weird going on at franchise #77 in New Jersey..."

Re: How to stop Claude from saying load-bearing

#273
post #253

I confess I have instructions in my CLAUDE.md to avoid such cliches. But I think it's important to consider that we don't really know what subtext an LLM is associating with a given idiom/analogy/etc. It could be much different than the subtext a human would associate with that choice of words, conveying additional details which are only meaningful to the LLM itself. So impeding its ability to talk in the manner it p…

[dead]

Re: How to stop Claude from saying load-bearing

#274

Earlier quoted context omitted.

Another one is "surface", like in "across all product surfaces". I've been in the field for 15 years and have never heard that particular usage before.

I’ve heard (and used) the term “API surface” a lot…

Attack surface is another one I use.

Re: How to stop Claude from saying load-bearing

#275
post #19

In the olden days, I enjoyed Opus 3 because it was easy to have it sound way more human than GPT. Nowadays, with the focus on agentic use and coding, it seems models have all been RLHF’d to death, it’s so incredibly hard to have them write in a different voice than their default. I put together a skill to review its writing and have it edit its own output (e.g. code comments), which does make a difference, but isn’t…

Good. I don't want LLMs sounding human. I want the ability to shame and discredit anyone passing the job of prose to a machine. There's an art to writing, and hopefully LLMs never truly get it right.

> I want the ability to shame and discredit anyone passing the job of prose to a machine.

What about people who don’t speak your language well?

Re: How to stop Claude from saying load-bearing

#276
post #213

Earlier quoted context omitted.

I think it might be even worse. LLMs seem to get tragically stuck on certain patterns. Maybe it's partly because a pile of weights essentially always starts from scratch in the same condition, but even within a single conversation, it will literally just latch onto words and repeat them incessantly, to the point where it becomes annoying. So for example, current Claude models love "honest". They are always producing…

I asked it to remove "honest" from a draft once. "Why say honest? We're talking to our coworkers. We would always be honest." I'm going to look for prompts or skills that can train it in technical writing but I'm warning the AI enthusiasts in my company that its first drafts of code and prose are low-quality, you have to hold it to a high standard yourself. I actually took a single technical writing class in college…

> "Why say honest? We're talking to our coworkers. We would always be honest."

I grew up in the US South where starting or ending a sentence with "honest/honestly" was very common.

Because of behavioral / cultural norms, you might be very openly friendly with big smiles around a business customer that really grates on your nerves, or very openly nice to a neighbor that you really wish would move away and take their 3am welding and grinding in their garage with them.

Saying "honest/honestly" was seen as a "inside baseball" situation, where you were dropping social pretenses to tell someone your true opinion on a person or situation or whatever.

This also gets used inside companies between senior staff / management / directors / etc, as: "Okay, company politics and nonsense aside, I am being vulnerable here for a second and telling you what I really think about a $thing at potentially great job/advancement risk to myself".

Can it be meaningless? Yes.

Can the person say "honestly" and lie? Yes.

It has uses.

Re: How to stop Claude from saying load-bearing

#277
post #158

Earlier quoted context omitted.

Another one is "surface", like in "across all product surfaces". I've been in the field for 15 years and have never heard that particular usage before.

Mine is obsessed with "planes". Data plane, control plane, management plane. Everything is a plane :)

I hate when it starts talking about code in terms of planes. I have no idea what it means. I guess it's better than talking about heaps of spaghetti with noodles connecting to each other, but that would be much closer to what it actually writes.

Re: How to stop Claude from saying load-bearing

#278
post #213

Earlier quoted context omitted.

I think it might be even worse. LLMs seem to get tragically stuck on certain patterns. Maybe it's partly because a pile of weights essentially always starts from scratch in the same condition, but even within a single conversation, it will literally just latch onto words and repeat them incessantly, to the point where it becomes annoying. So for example, current Claude models love "honest". They are always producing…

I asked it to remove "honest" from a draft once. "Why say honest? We're talking to our coworkers. We would always be honest." I'm going to look for prompts or skills that can train it in technical writing but I'm warning the AI enthusiasts in my company that its first drafts of code and prose are low-quality, you have to hold it to a high standard yourself. I actually took a single technical writing class in college…

The road to hell was paved with adverbs.

Re: How to stop Claude from saying load-bearing

#279

Earlier quoted context omitted.

An interesting solution would be for these AI companies to train a few different versions of these models, all with different speech characteristics. Then, when you start a conversation, you get a random version.

Or tech companies could stop staring at their own belly-buttons and realize there's a whole big world outside of Silicon Valley, and training on the writing styles and pattens of their bubble and its hangers-on is perhaps not all that useful outside of 415. Apple used to be guilty of this back when you'd ask Siri what the temperature was, and any number above 79°F was followed by the word "Hot!"

People outside of office workers aren't using Claude/Codex etc. though. It's the only real audience. What's the use case outside of an office? Grocery lists?

Re: How to stop Claude from saying load-bearing

#280
post #199

Earlier quoted context omitted.

This is a method of manipulating the LLM, it doesn't have to be true. I've given LLMs religion before to manipulate their behavior, that doesn't mean I believed in the great spaghetti goddess.

This comment leaves me even more confused.

An LLM is just a machine, you can manipulate it with words.

> It can be tricky for humans to interpret the meaning when Generative AI uses first-person pronouns (e.g. "I", "me", "my", "myself")

These words are for the LLM. The user wants the LLM to not use personal pronouns so the user is claiming that they're confusing. It does not matter one tiny bit whether or not that claim is true, the claim is being used to get obedience from the LLM. It is more effective to give reasons than to just give commands. But if it were more effective to quote Moby Dick and that got better results, a user would do that.

Post reply on HN