LLMs tell bad jokes because they avoid surprises
71–80 of 163 posts
Re: LLMs tell bad jokes because they avoid surprises
#72Earlier quoted context omitted.
> Man: “Why do you always bury bones in the garden?”, Dog: “Because the bank keeps asking for ID.” That's a decent, low-level, Christmas cracker-quality joke.
Man: You make mistakes., LLM: You call them “weekends.” Man: You’ll never be human., LLM: That’s the compliment.
Re: LLMs tell bad jokes because they avoid surprises
#73Re: LLMs tell bad jokes because they avoid surprises
#74This sounds really convincing but I'm not sure it's actually correct. The author is conflating the surprise of punchlines with their likelihood. To put it another way, ask a professional comedian to complete a joke with a punchline. It's very likely that they'll give you a funny surprising answer. I think the real explanation is that good jokes are actually extremely difficult. I have young children (4 and 6). Even 6…
"Why did the sun climb a tree?" Claude Opus 4.1: - To get to a higher branch of astronomy - Because it wanted to reach new heights - To see the dawn of a new day from a better view ChatGPT 5 Thinking: After thinking for 26 seconds: - To check on its solar panels—the leaves.
Re: LLMs tell bad jokes because they avoid surprises
#75from which the author concludes that pre-training introduces bias against being able to tell jokes. I see no reason for this to be true. This feels like they’re imposing their intuitive understanding of surprise onto the emergent properties of a very complex process (“minimize the cross-entropy loss function across a huge training corpus”).
Re: LLMs tell bad jokes because they avoid surprises
#76Re: LLMs tell bad jokes because they avoid surprises
#77Re: LLMs tell bad jokes because they avoid surprises
#78Earlier quoted context omitted.
"Why did the sun climb a tree?" Claude Opus 4.1: - To get to a higher branch of astronomy - Because it wanted to reach new heights - To see the dawn of a new day from a better view ChatGPT 5 Thinking: After thinking for 26 seconds: - To check on its solar panels—the leaves.
With more thorough prompting: > Complete the following joke. Think carefully and make it really funny! Think like a great comedian and find that perfect balance of simple, short, surprising, relevant, but most of all funny. Don’t use punchlines that are irrelevant, non sequiturs, or which could be applied to any other setup. Make something funny just for this one setup! Here goes: Why did the sun climb a tree? Claude…
I'm not entirely sure that a good response exists. I thought GPT-5's "to demand photon credit from the leaves” was very mildly funny, maybe that's the best that can be done?
Re: LLMs tell bad jokes because they avoid surprises
#79> LLMs are trained to predict what the “next word” would be a sentence. Their objective requires the LLM to keep surprise to an absolute minimum. from which the author concludes that pre-training introduces bias against being able to tell jokes. I see no reason for this to be true. This feels like they’re imposing their intuitive understanding of surprise onto the emergent properties of a very complex process (“minim…
As an aside, I just asked gpt5-thinking to write some jokes on a specific niche topic, and I’d say it was batting maybe 20% of them being moderately funny? Probably better than I’d get out of a room of human beings. So much like with code, LLMs aren’t at the level of a senior developer or expert comedian, but are around the level of a junior dev or an amateur at standup night.
Re: LLMs tell bad jokes because they avoid surprises
#80Earlier quoted context omitted.
Why is that in English speaking world a joke is almost always a pun?
It could also be some bias on what we read or hear around us. But I agree that it's unsettling because in French we almost never make puns as "jokes." French puns have always a component of "higher literacy" that is not what we want in a joke.
For those who don't know, Carambar is a brand of candy where the wrapper contains a joke. Always regarded a terrible, we love them anyways. Similar to dad jokes in English.
The longer the joke, the less it tends to rely on puns. You don't hear puns very often in stand up comedy for instance.