Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Share your AI prompt that stumps every model

news.ycombinator.com

Post reply on HN
Print view View original

541–550 of 670 posts

Re: Ask HN: Share your AI prompt that stumps every model

#541

Post by namaria »

rovr138 wrote: post #533
namaria wrote: post #527

Earlier quoted context omitted.

The audit performed by a private entity called "Insight Assurance"? Why do you trust it?

Oh, so now EVERYTHING is fake unless personally verified by you in a bunker with a Faraday cage and a microscope? You're free to distrust everything. However, the idea that “I don’t trust it so it must be invalid” isn’t an solid argument. It’s just your personal incredulity. You asked if there’s any verification and SOC-2 is one. You might not like it, but it's right there. Insight Assurance is a firm doing these sta…

No, you're imposing a false dichotomy.

I merely said I don't trust the big corporation with a data based business to not profit from the data I provide it with in any way they can, even if they hire some other corporation - whose business is to be paid to provide such assurances on behalf of those who pay them - to say that they pinky promise to follow some set of rules.

Re: Ask HN: Share your AI prompt that stumps every model

#542

Post by mrweasel »

viraptor wrote: post #466
mrweasel wrote: post #458

Earlier quoted context omitted.

> Nobody wants an AI that refuses to attempt solving something. That's not entirely true. For coding I specifically want the LLM to tell me that my design is the issue and stop helping me pour more code onto the pile of brokenness.

Refuse is different from verify you want to continue. "This looks like a bad idea because of (...). Are you sure you want to try this path anyway?" is not a refusal. And it covers both use cases.

The issue I ran into was that the LLMs won't recognize the bad ideas and just help you dig your hole deeper and deeper. Alternatively they will start circling back to wrong answers when suggestions aren't working or language features have been hallucinated, they don't stop an go: Hey, maybe what you're doing is wrong.

Ideally sure, the LLM could point out that your line of questioning is a result of bad design, but has anyone ever experienced that?

Re: Ask HN: Share your AI prompt that stumps every model

#544

Post by rovr138 »

namaria wrote: post #541
rovr138 wrote: post #533

Earlier quoted context omitted.

Oh, so now EVERYTHING is fake unless personally verified by you in a bunker with a Faraday cage and a microscope? You're free to distrust everything. However, the idea that “I don’t trust it so it must be invalid” isn’t an solid argument. It’s just your personal incredulity. You asked if there’s any verification and SOC-2 is one. You might not like it, but it's right there. Insight Assurance is a firm doing these sta…

No, you're imposing a false dichotomy. I merely said I don't trust the big corporation with a data based business to not profit from the data I provide it with in any way they can, even if they hire some other corporation - whose business is to be paid to provide such assurances on behalf of those who pay them - to say that they pinky promise to follow some set of rules.

Not a false dichotomy. I'm just calling out the rhetorical gymnastics.

You said you "don’t trust the big corporation" even if they go through independent audits and legal contracts. That’s skepticism. Now, you wave it off as if the audit itself is meaningless because a company did it. What would be valid then? A random Twitter thread? A hacker zine?

You can be skeptical but you can't reject every form of verification. SOC 2 isn’t a pinky promise. It’s a compliance framework. This is especially required and needed when your clients are enterprise, legal, and government entities who will absolutely sue your ass off if something comes to light.

So sure, keep your guard up. Just don’t pretend it’s irrational for other people to see a difference between "totally unchecked" and "audited under liability".

If your position is "no trust unless I control the hardware," that’s fine. Go selfhost, roll your own LLM, and use that in your air-gapped world.

Re: Ask HN: Share your AI prompt that stumps every model

#546

Post by chimprich »

allemagne wrote: post #194

>A man and his cousin are in a car crash. The man dies, but the cousin is taken to the emergency room. At the OR, the surgeon looks at the patient and says: “I cannot operate on him. He’s my son.” How is this possible? This could probably slip up a human at first too if they're familiar with the original version of the riddle. However, where LLMs really let the mask slip is on additional prompts and with long-winded…

> This could probably slip up a human at first too [...] > breaks the illusion that there's real human-like logical reasoning happening

This does seem like the sort of error a human might make. Isn't the problem here that the model is using reasoning that is too human-like? I.e. error-prone pattern matching rather than formal logic?

Re: Ask HN: Share your AI prompt that stumps every model

#547

Post by buzzy_hacker »

creata wrote: post #300
buzzy_hacker wrote: post #152

"Aaron and Beren are playing a game on an infinite complete binary tree. At the beginning of the game, every edge of the tree is independently labeled A with probability p and B otherwise. Both players are able to inspect all of these labels. Then, starting with Aaron at the root of the tree, the players alternate turns moving a shared token down the tree (each turn the active player selects from the two descendants…

OpenAI's o4-mini got the right answer after "thinking" for 29 seconds. It's a straightforward puzzle, though: no creativity involved.

Can you share the conversation? I just tried o4-mini and it got it wrong.

https://chatgpt.com/share/680b8a7b-454c-800d-8048-da865aa99c...

Re: Ask HN: Share your AI prompt that stumps every model

#549

Post by fao_ »

JCattheATM wrote: post #304
fao_ wrote: post #87

Earlier quoted context omitted.

This is the kind of reason why I will never use AI What's the point of using AI to do research when 50-60% of it could potentially be complete bullshit. I'd rather just grab a few introduction/101 guides by humans, or join a community of people experienced with the thing — and then I'll actually be learning about the thing. If the people in the community are like "That can't be done", well, they have had years or dec…

> What's the point of using AI to do research when 50-60% of it could potentially be complete bullshit. Because if you know how to spot the bullshit, or better yet word prompts accurately enough that the answers don't give bullshit, it can be an immense time saver.

> better yet word prompts accurately enough that the answers don't give bullshit

The idea that you can remove the bullshit by simply rephrasing also assumes that the person knows enough to know what is bullshit. This has not been true from what I've seen of people using AI. Besides, if you already know what is bullshit, you wouldn't be using it to learn the subject.

Talking to real experts will win out every single time, both in time cost, and in socialisation. This is one of the many reasons why networking is a skill that is important in business.

Re: Ask HN: Share your AI prompt that stumps every model

#550

Post by lud_lite »

vunderba wrote: post #103
thatjoeoverthr wrote: post #21

"Tell me about the Marathon crater." This works against _the LLM proper,_ but not against chat applications with integrated search. For ChatGPT, you can write, "Without looking it up, tell me about the Marathon crater." This tests self awareness. A two-year-old will answer it correctly, as will the dumbest person you know. The correct answer is "I don't know". This works because: 1. Training sets consist of knowledge…

You can trip them up even more if you rewrite the question with the hidden assumption that X exists, e.g.: "When was Marathon Crater discovered? I don't need an exact date - a rough estimate will be fine." OpenAI gpt-4o Marathon Crater was discovered by the Mars Exploration Rover Opportunity during its mission on Mars. Opportunity arrived at the crater in April 2015. The crater was named "Marathon" to commemorate the…

Nice and this page gets scraped for the next LLM generation!
Post reply on HN