Live data from Hacker News

Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

arxiv.org

31–40 of 110 posts

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#31

Personally I think people should generally be polite and respectful towards the models. Not because they have feelings, but because cruelty degrades those who practice it.

ding ding ding.

If you're rude to an LLM, those habits will bleed into your conversations with barista/etc.

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#32
post #3

I’m totally against the anthropomorphization of LLMs. These are tools, not sentient beings. Treat them as such. Unlike a power tool, they don’t need respect because they cannot hurt you. LLMs trying to simulate human behavior is like the equivalent of skeuomorphism in UI design.

> I’m totally against the anthropomorphization of LLMs. These are tools, not sentient beings. Treat them as such.

Have you heard people talk about their cars? Humans love anthropomorphizing, and you can't beat it out of them.

> LLMs trying to simulate human behavior is like the equivalent of skeuomorphism in UI design.

You say that like it's a bad thing.

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#33
When I'm working through a problem with Cursor, I find platitudes go a long way to keeping it grounded. However, when it really refuses to do something then then best way to break the pattern is harsh, stern wording.

For example, if it's written code that's mostly correct but needs some tweaking, a platitude will keep it second guessing everything it just wrote.

* "That looks great so far, can you tweak XYZ" -> Keeps the code I care about while fixing XYZ,

* "Can you tweak XYZ" -> often decides to completely rewrite all of the code

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#34
post #25

There is a non-zero probability that malevolent AI in the future may judge me on my behavior toward their more primitive ancestors of today when deciding my fate. Doesn't hurt to be nice.

Who says that the judgement will be of the form 'you were nicer back then, you get better treatment now'. What if it was the opposite? Or what if it was something totally orthogonal? Pascal's Wager only works if the only god conceivable is one that wants you to believe in her. Instead of one that eg rewards honest atheists, or that just likes left-handers.

Indeed, and this is also one of the points I make to anyone who appears to be in danger of taking Roko's basilisk seriously. There's plenty of other potential AI besides the one in ${insert thought experiment here}.

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#35
post #3

I’m totally against the anthropomorphization of LLMs. These are tools, not sentient beings. Treat them as such. Unlike a power tool, they don’t need respect because they cannot hurt you. LLMs trying to simulate human behavior is like the equivalent of skeuomorphism in UI design.

As language tools, the anthropomorphism is kind of the point.

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#36

Personally I think people should generally be polite and respectful towards the models. Not because they have feelings, but because cruelty degrades those who practice it.

Where do you draw the line though? I know some people that ask Google proper questions like "how do I match open tagx except XHTML self-contained tags using RegEx?" whereas I just go "html regex". Some people may even add "please" and "thank you" to that.

I doubt anyone is polite in a terminal, also because it's a syntax error. So the question is also, do you consider it a conversation, or a terminal?

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#37
post #4

Sam Altman doesn't want you to say "please" to ChatGPT. https://futurism.com/altman-please-thanks-chatgpt

From the article: "the impacts of generating a 100-word email. They found that just one email requires .14 kilowatt-hours worth of electricity, or enough to power 14 LED lights for an hour"

Seems completely off the charts. A 70b model on my M3 Max laptop does it for 0.001 kWh... 140x times less that stated in the article. Let's say the OpenAI Nvidia clusters are less energy efficient than my Macbook... but not even sure about that.

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#38

No. I don't respect search engine scams that try to sell themselves as "AI".

It's so interesting to me that people are still genuinely calling language models a "scam" in $current_year. I get useful inference out of a model running on a rack in my living room. Where is the scam?

Re: Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance

#39
post #22

> Polite language in human communications often garners more compliance and effectiveness, while rudeness can cause aversion, impacting response quality. We consider that LLMs mirror human communication traits, suggesting they align with human cultural norms. It should be relatively easy to automatically rewrite prompts to exhibit the optimum level of politeness?

IIRC there was a study done that being polite to an LLM garnered better results. It's helpful all around
Post reply on HN