Live data from Hacker News

I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

mastodon.world

711–720 of 998 posts

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#711
post #63

Earlier quoted context omitted.

Opus 4.6: Walk! At 50 meters, you'll get there in under a minute on foot. Driving such a short distance wastes fuel, and you'd spend more time starting the car and parking than actually traveling. Plus, you'll need to be at the car wash anyway to pick up your car once it's done.

Lmao, and this is what they are saying will be an AGI in 6 months?

They seem to have stopped talking about AGI and pivoted to ads and smut.

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#712
post #379

Earlier quoted context omitted.

Unless the LLM is a base model or just a finetuned base model, it definitely doesn't predict words just based on how likely they are in similar sentences it was trained on. Reinforcement learning is a thing and all models nowadays are extensively trained with it. If anything, they predict words based on a heuristic ensemble of what word is most likely to come next in similar sentences and what word is most likely to…

> If anything, they predict words based on a heuristic ensemble of what word is most likely to come next in similar sentences and what word is most likely to give a final higher reward. So... "finding the most likely next word based on what they've seen on the internet"?

Reinforcement learning is not done with random data found on the internet; it's done with curated high-quality labeled datasets. Although there have been approaches that try to apply reinforcement learning to pre-training[1] (to learn in an unsupervised way a predict-the-next-sentence objective), as far as I know it doesn't scale.

[1] https://arxiv.org/pdf/2509.19249

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#713
post #691

Earlier quoted context omitted.

The Lojban language already exists and allows for eliminating ambiguity. It's obviously not practical for general use, though. https://en.wikipedia.org/wiki/Lojban

Lojban is syntactically unambitious. Semantically it's still just as vague as any natural language.

It reminds me of the difficulty of getting information on or off a blockchain. Yes, you’ve created this perfect logical world. But, getting in or out will transform you in unknown ways. It doesn’t make our world perfect.

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#715

I've used LLMs enough that I have a good sense of their _edges_ of intelligence. I had assumed that reasoning models should easily be able to answer this correctly. And indeed, Sonnet and Opus 4.5 (medium reasoning) say the following: Sonnet: Drive - you need to bring your car to the car wash to get it washed! Opus: You'll need to drive — you have to bring the car to the car wash to get it washed! Gemini 3 Pro (mediu…

ChatGPT 5.2 Thinking yields the same answer - walk.

If I append 'think carefully' to the end of the prompt, it returns driving as the correct answer.

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#716

Earlier quoted context omitted.

By "patched", you can't mean they added something to the internal prompt to show it how to answer this one specific question?!

Absolutely. There is a preflight guardrail that steers specific words, phrases, concepts with tweaked output.

Such AGI wow!

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#717
post #469

This trick went viral on TikTok last week, and it has already been patched. To get a similar result now, try saying that the distance is 45 meters or feet. The new one is with upside down glass: https://www.tiktok.com/t/ZP89Khv9t/

Ah yes, one of those novelty reversible cups.

This is a trick cup, so it's okay to have a laugh.

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#719

Now shudder at the thought that people are pushing towards building more and more of the world's infrastructure with this kind of thinking.

Now shudder at the fact that the error rate for hunan-written software isn't much better: https://xkcd.com/2030/

Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

#720

IMO this is a great example of how we're often asking loaded questions without realizing it. IMO it's the same when we're asking: "Should I implement X from scratch, or import a small library to do it?" vs "Should I add feature X to the codebase or bring in another dependency for it?" In the first question, it sounds like a good idea to not reinvent the wheel, in the second it sounds bad to have dependency.

My experience with Chatbots outside of a coding context also ends up like this. A while ago I asked: Is "Read more" an appropriate project for the Getting things done framework? - The answer, yes, it was. Then I asked "Is Read More too big of a project to be appropriate for the GTD Framework" - The answer? Yes, it was far too big.

Answering questions in the positive is a simple kind of bias that basically all LLMs have. Frankly if you are going to train on human data you will see this bias because its everywhere.

LLMs have another related bias though, which is a bit more subtle and easy to trip up on, which is that if you give options A or B, and then reorder it so it is B or A, the result may change. And I don't mean change randomly the distribution of the outcomes will likely change significantly.

Post reply on HN