Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Share your AI prompt that stumps every model

news.ycombinator.com

Post reply on HN
Print view View original

271–280 of 670 posts

Re: Ask HN: Share your AI prompt that stumps every model

#271

Post by nyrikki »

imoreno wrote: post #185
robviren wrote: post #68

"If I can dry two towels in two hours, how long will it take me to dry four towels?" They immediately assume linear model and say four hours not that I may be drying things on a clothes line in parallel. It should ask for more context and they usually don't.

Fascinating! Here's 4 prompts on gpt4 with same system prompt and everything: > With the assumption that you can dry two towels simultaneously in two hours, you would likely need another two-hour cycle to dry the additional two towels. Thus, drying four towels would take a total of four hours. >Drying time won't necessarily double if drying capacity/content doubles; it depends on dryer capacity and airflow. If your d…

> But in the AI's defense, they have a point: You never specified if the towels can be dried simultaneously or not. Maybe you have to use a drying machine that can only do one at a time. This one seems to consistently work:

This is the inverse of the Frame Problem, or the Qualification problem:

John McCarthy's paper related to it from the 1980's

http://jmc.stanford.edu/articles/circumscription/circumscrip...

It is still very relevent to modern AI efforts.

Re: Ask HN: Share your AI prompt that stumps every model

#272

Post by alexjplant »

LeonardoTolstoy wrote: post #74

Something about an obscure movie. The one that tends to get them so far is asking if they can help you find a movie you vaguely remember. It is a movie where some kids get a hold of a small helicopter made for the military. The movie I'm concerned with is called Defense Play from 1988. The reason I keyed in on it is because google gets it right natively ("movie small military helicopter" gives the IMDb link as one of…

Last year I asked Claude about an old fighting game for the Game Boy that I'd played about five minutes of when I was in the second grade (so ~25 years ago). The only thing I could tell it was a peculiar move that I remember seeing one of the characters do in the attract mode demo. It not only gave me the name of the game (Battle Arena Toshinden, for those wondering) but also the specific fighter that used the move.

I've tried it for similar cases and have only had a 50% success rate. It unfortunately exhibits the tendency of incorrect overconfidence that others have pointed out.

Re: Ask HN: Share your AI prompt that stumps every model

#273

Post by jaffa2 »

Der_Einzige wrote: post #252
miki123211 wrote: post #94

No, please don't. I think it's good to keep a few personal prompts in reserve, to use as benchmarks for how good new models are. Mainstream benchmarks have too high a risk of leaking into training corpora or of being gamed. Your own benchmarks will forever stay your own.

[flagged]

I never heard of this phrase before ( i had heard the concept , i think this is similar to the paperclip problem) but now in 2 days ive heard it twice here and on youtube. Rokokos basilisk.

Re: Ask HN: Share your AI prompt that stumps every model

#276

Post by dgunay »

tunesmith wrote: post #259

Pretty much any advanced music theory question. Or even just involving transposed chord progressions.

Every time I've tried to get an LLM to find a piece of music for me based on a description of the texture, chord structure, instruments etc. it fails miserably.

Re: Ask HN: Share your AI prompt that stumps every model

#280

Post by harrall »

hnuser123456 wrote: post #251
crazygringo wrote: post #196

Earlier quoted context omitted.

But this is going to be in every AI's training set. I just fed ChatGPT your exact prompt and it gave back exactly what I expected: This is a classic riddle that challenges assumptions. The answer is: The surgeon is the boy’s mother. The riddle plays on the common stereotype that surgeons are male, which can lead people to overlook this straightforward explanation.

The surgeon could be the cousin's mom or dad. The cousin's dad didn't die in the crash, his cousin did. The question "how is this possible?" implies there is some sort of contradiction when there isn't any at all. It has nothing to do with sexism, and to say it does reflects a bias in the reader causing them to "spidey sense" a cultural bugaboo when it's utterly irrelevant in this scenario.

Can someone explain to me how I read it wrong?

I read it as 2 cousins are in an accident and 1 of the cousins is the son of the surgeon.

What was the contradictory statement that I missed?

Post reply on HN