Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Share your AI prompt that stumps every model

news.ycombinator.com

Post reply on HN
Print view View original

401–410 of 670 posts

Re: Ask HN: Share your AI prompt that stumps every model

#401

Post by ethersteeds »

idon4tgetit wrote: post #227
imoreno wrote: post #166

Earlier quoted context omitted.

Yes let's not say what's wrong with the tech, otherwise someone might (gasp) fix it!

"Fix". So long as the grocery store has groceries, most people will not care what a chat bot spews. This forum is full of syntax and semantics obsessed loonies who think the symbolic logic represents the truth. I look forward to being able to use my own creole to manipulate a machine's state to act like a video game or a movie rather than rely on the special literacy of other typical copy-paste middle class people. T…

Go get em tiger!

Re: Ask HN: Share your AI prompt that stumps every model

#402

Post by namaria »

viraptor wrote: post #361
EGreg wrote: post #266

Earlier quoted context omitted.

Yes. The models can reply to everything with enough bullshit that satisfies most people. There is nothing you ask that stumps them. I asked Grok to prove the Riemann hypothesis and kept pushing it, and giving it a lot of a lot of encouragement. If you read this, expand "thoughts", it's pretty hilarious: https://x.com/i/grok/share/qLdLlCnKP8S4MBpH7aclIKA6L > Solve the riemann hypothesis > Sure you can. AIs are much sm…

Nobody wants an AI that refuses to attempt solving something. We want it to try and maybe realise when all paths it can generate have been exhausted. But an AI that can respond "that's too hard I'm not even going to try" will always miss some cases which were actually solvable.

So we need LLMs to solve the halting problem?

Re: Ask HN: Share your AI prompt that stumps every model

#403

Post by isoprophlex »

mncharity wrote: post #263
imoreno wrote: post #180

Earlier quoted context omitted.

LLMs currently have the "eager beaver" problem where they never push back on nonsense questions or stupid requirements. You ask them to build a flying submarine and by God they'll build one, dammit! They'd dutifully square circles and trisect angles too, if those particular special cases weren't plastered all over a million textbooks they ingested in training. I suspect it's because currently, a lot of benchmarks are…

> they never push back on nonsense questions or stupid requirements "What is the volume of 1 mole of Argon, where T = 400 K and p = 10 GPa?" Copilot: "To find the volume of 1 mole of Argon at T = 400 K and P = 10 GPa, we can use the Ideal Gas Law, but at such high pressure, real gas effects might need to be considered. Still, let's start with the ideal case: PV=nRT" > you really don't need to worry about teaching a h…

Don't use copilot, it's worse than useless. Claude understands that it's a solid on the first try.

Re: Ask HN: Share your AI prompt that stumps every model

#405

Post by GoToRO »

captainkrtek wrote: post #197
GoToRO wrote: post #195

Earlier quoted context omitted.

They do. Recently I was pleasantly surprised by gemini telling me that what I wanted to do will NOT work. I was in disbelief.

Interesting, can you share more context on the topic you were asking it about?

coding in a stack I didn't bother to learn first (android)

Re: Ask HN: Share your AI prompt that stumps every model

#406

Post by namaria »

rybosworld wrote: post #176
imoreno wrote: post #166

Earlier quoted context omitted.

Yes let's not say what's wrong with the tech, otherwise someone might (gasp) fix it!

Tuning the model output to perform better on certain prompts is not the same as improving the model. It's valid to worry that the model makers are gaming the benchmarks. If you think that's happening and you want to personally figure out which models are really the best, keeping some prompts to yourself is a great way to do that.

There is no guarantee for you that by keeping your questions to yourself that no one else has published something similar. This is bad reasoning all the way through. The problem is in trying to use a question as a benchmark. The only way to really compare models is to create a set of tasks of increasing compositional complexity and running the models you want to compare through them. And you'd have to come up with a new body of tasks each time a new model is published.

Providers will always game benchmarks because they are a fixed target. If LLMs were developing general reasoning, that would be unnecessarily. The fact that providers do is evidence that there is no general reasoning, just second order overfitting (loss on token prediction does descend, but that doesn't prevent the 'reasoning loss' to be uncontrollable: cf. 'hallucinations').

Re: Ask HN: Share your AI prompt that stumps every model

#407

Post by GoToRO »

sgtnoodle wrote: post #353
GoToRO wrote: post #195

Earlier quoted context omitted.

They do. Recently I was pleasantly surprised by gemini telling me that what I wanted to do will NOT work. I was in disbelief.

I asked Gemini to format some URLs into an XML format. It got halfway through and gave up. I asked if it truncated the output, and it said yes and then told _me_ to write a python script to do it.

That's a different kind of push back.

Re: Ask HN: Share your AI prompt that stumps every model

#408

Post by sirclueless »

schlauerfox wrote: post #312
JCattheATM wrote: post #297

Earlier quoted context omitted.

It's a completely nonsense argument and should be dismissed instantly.

I was so much more comfortable when I realized it's just Pascal's wager, and just as absurd.

I don't think it's absurd at all. I think it is a practical principle that shows up all the time in collective action problems. For example, suppose hypothetically there were a bunch of business owners who operated under an authoritarian government which they believed was bad for business, but felt obliged to publicly support it anyways because opposing it could lead to retaliation, thus increasing its ability to stay in power.

Re: Ask HN: Share your AI prompt that stumps every model

#409

Post by namaria »

echoangle wrote: post #141
alganet wrote: post #102

Earlier quoted context omitted.

That doesn't make any sense.

Why not? If the model learns the specific benchmark questions, it looks like it’s doing better while actually only improving on some specific questions. Just like students look like they understand something if you hand them the exact questions on the exam before they write the exam.

A benchmark that can be gamed cannot be prevented from being gamed by 'security through obscurity'.

Besides this whole line of reasoning is preempted by the mathematical limits to computation and transformers anyway. There's plenty published about that.

Sharing questions that make LLM behave funny is (just) a game without end, there's no need to or point in "hoarding questions".

Re: Ask HN: Share your AI prompt that stumps every model

#410

Post by isoprophlex »

segmondy wrote: post #135
siva7 wrote: post #95

"Keep file size small when you do edits" Makes me wonder if all these models were heavily trained on codebases where 1000 LOC methods are considered good practice

I have not seen any model, not one, that could generate 1000 lines of code.

Every time I ask claude code to please fix this CSV import it starts to add several hundred lines of random modules, byzantine error handling, logging bullshit... with the pinnacle a 1240 line CRUD API when i asked it to add a CLI :/

I'm back to copying and pasting stuff into a chat window, so I have a bit more control over what those deranged, expensive busy beavers want to cook up.

Post reply on HN