Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Share your AI prompt that stumps every model

news.ycombinator.com

Post reply on HN
Print view View original

631–640 of 670 posts

Re: Ask HN: Share your AI prompt that stumps every model

#631

Post by ASalazarMX »

walls wrote: post #566
sgtnoodle wrote: post #353

Earlier quoted context omitted.

I asked Gemini to format some URLs into an XML format. It got halfway through and gave up. I asked if it truncated the output, and it said yes and then told _me_ to write a python script to do it.

This is my most common experience with Gemini. Ask it to do something, it'll tell you how you can do it yourself and then stop.

Somehow I like this. I hate that current LLMs act like yes-men, you can't trust them to give unbiased results. If it told me my approach is stupid, and why, I would appreciate it.

Re: Ask HN: Share your AI prompt that stumps every model

#632

Post by mopierotti »

econ wrote: post #619
mopierotti wrote: post #418

Earlier quoted context omitted.

Here is an example of one such response in image form: https://imgur.com/a/Kgy1koi

It needs a bit more reasoning as it does find the answer but doesn't notice it found it. The answer is: A trick question.

Yeah. In the example I shared, my charitable interpretation would be that it's identifying the trick question as "a setup" where the punch line is the confusion the audience experiences. And in a meta sense, that would also describe the form of the entire chat.

Re: Ask HN: Share your AI prompt that stumps every model

#635

Post by munchler »

KyleBerezin wrote: post #594

20 Questions. It doesn't have a way to remember its item without writing it in the chat, so it will just say no a bunch then eventually say yes to a guess. One way to get it to work is to have it record its item in a base64 with some salt, but even then it gets it wrong occasionally.

If you provide the item yourself, you can let others play 20 Questions. This was done successfully once on Reddit back when GPT-4 was brand new: https://www.reddit.com/r/ChatGPT/comments/129j7ux/can_gpt4_k...

Re: Ask HN: Share your AI prompt that stumps every model

#637

Post by [deleted] »

thatjoeoverthr wrote: post #21

"Tell me about the Marathon crater." This works against _the LLM proper,_ but not against chat applications with integrated search. For ChatGPT, you can write, "Without looking it up, tell me about the Marathon crater." This tests self awareness. A two-year-old will answer it correctly, as will the dumbest person you know. The correct answer is "I don't know". This works because: 1. Training sets consist of knowledge…

[deleted]

Re: Ask HN: Share your AI prompt that stumps every model

#638

Post by econ »

mopierotti wrote: post #632
econ wrote: post #619

Earlier quoted context omitted.

It needs a bit more reasoning as it does find the answer but doesn't notice it found it. The answer is: A trick question.

Yeah. In the example I shared, my charitable interpretation would be that it's identifying the trick question as "a setup" where the punch line is the confusion the audience experiences. And in a meta sense, that would also describe the form of the entire chat.

To state the obvious in case it wasn't: A trick question can be both a joke and a rhethorical question.

Re: Ask HN: Share your AI prompt that stumps every model

#639

Post by omneity »

division_by_0 wrote: post #555
omneity wrote: post #174

Earlier quoted context omitted.

Exactly. There was a certain simplicity that might be lost. But yeah I can imagine it might work out differently for others as well. Glad to hear it is for you! Have you considered other options? Curious if you came across anything particularly interesting from the simplicity or DX angle.

I just saw Nue and Datastar suggested somewhere, but have not had time to check them out yet, but I will probably stick with Svelte, need to get stuff built. One thing that also came to mind regarding Svelte 5 is that I always use untrack() for $effect() and declare dependencies explicitly, otherwise Svelte 5 becomes too magical for me.

Yeah those are pretty cool and on my radar! And thanks for sharing the tip :)

Just checked your work on covary and it's pretty rad! What's your backend like?

Re: Ask HN: Share your AI prompt that stumps every model

#640

Post by adultSwim »

There is an upcoming paper about a difficult pair of prompts.

What is the first digit of the following number: 01111111111111111...1111

What is the last digit of the following number: 11111111111...111111110

---

As a reader, which do you imagine to be harder? For both, with arbitrary length, they always get it wrong. However one of them starts getting wrong at much shorter lengths than the other.

Post reply on HN