Live data from Hacker News

Ask HN: Share your AI prompt that stumps every model

news.ycombinator.com

11–20 of 670 posts

Re: Ask HN: Share your AI prompt that stumps every model

#13

I don't have a prompt per-say.. but recently I have managed to ask certain questions of both openai o1/o3 and claude extended thinking 3.7 that have spiraled way out of control. A simple high-level architecture question with an emphasis on do not produce code lets just talk thru this yields nearly 1,000 lines of SQL. Once the conversation/context gets quite long it is more likely to occur, in my experience.

The only model I've seen so far that doesn't end up going crazy with long contexts with Gemini 2.5 pro, but tbf I haven't gone past 700-750k total tokens so maybe as it starts to approach the limit (1.05M) things get hairy?

Re: Ask HN: Share your AI prompt that stumps every model

#14
post #6

A ball costs 5 cents more than a bat. Price of a ball and a bat is $1.10. Sally has 20 dollars. She stole a few balls and bats. How many balls and how many bats she has? All LLMs I tried miss the point that she stole things and not bought them

gemini 2.5 give following response.

Conclusion:

We can determine the price of a single ball ($0.575) and a single bat ($0.525). However, we cannot determine how many balls and bats Sally has because the information "a few" is too vague, and the fact she stole them means her $20 wasn't used for the transaction described.

Re: Ask HN: Share your AI prompt that stumps every model

#15
post #6

A ball costs 5 cents more than a bat. Price of a ball and a bat is $1.10. Sally has 20 dollars. She stole a few balls and bats. How many balls and how many bats she has? All LLMs I tried miss the point that she stole things and not bought them

lol, nice way to circumvent the attention algorithm

Re: Ask HN: Share your AI prompt that stumps every model

#17
post #6

A ball costs 5 cents more than a bat. Price of a ball and a bat is $1.10. Sally has 20 dollars. She stole a few balls and bats. How many balls and how many bats she has? All LLMs I tried miss the point that she stole things and not bought them

Grok 3.0 wasn’t fooled on this one, either:

Final Answer: The problem does not provide enough information to determine the exact number of balls and bats Sally has. She stole some unknown number of balls and bats, and the prices are $0.575 per ball and $0.525 per bat.

Re: Ask HN: Share your AI prompt that stumps every model

#19
post #16

Nope, not doing this. Likely you shouldn't either. I don't want my few good prompts to get picked up by trainers.

May I ask outside of normal curiosity, what good is a prompt that breaks a model? And what is trying to keep it "secret"?

Being able to test future models without fear that your prompt has just been trained on an answer on HN, I assume.

Re: Ask HN: Share your AI prompt that stumps every model

#20

Write 20 sentences that end with "p"

  Write 20 sentences that end with "p" in the final word before the period or other punctuation.
Succeeded on ChatGPT, pretty close on gemma3:4b -- the exceptions usually ending with a "puh" sound...
Post reply on HN