Earlier quoted context omitted.
> Us having to specify things that we would never specify This is known, since 1969, as the frame problem: https://en.wikipedia.org/wiki/Frame_problem . An LLM's grasp of this is limited by its corpora, of course, and I don't think much of that covers this problem, since it's not required for human-to-human communication.
A modern LLMs corpora is every piece of human writing ever produced.
I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
481–490 of 998 posts
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#482Gemini fast > That is a classic "efficiency vs. logic" dilemma. Honestly, unless you’ve invented a way to teleport or you're planning on washing the car with a very long garden hose from your driveway, you’re going to have to drive. > While 50 meters is a great distance for a morning stroll, it’s a bit difficult to get the car through the automated brushes (or under the pressure washer) if you aren't behind the wheel…
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#483Earlier quoted context omitted.
I'd argue that "assumptions", i.e. the statistical models it uses to predict text, is basically what makes LLMs useful. The problem here is that its assumptions are naive. It only takes the distance into account, as that's what usually determines the correct response to such a question.
I think that’s still anthropomorphization. The point I’m making is that these things aren’t “assumptions” as we characterize them, not from the model’s perspective. We use assumptions as an analogy but the analogy becomes leaky when we get to the edges (like this situation).
And in the case of an LLM, walking a noncommutative path down a probabilistic knowledge manifold, it's incorrect to oversimplify the model's capabilities as simply parroting a training dataset. It has an internal world model and is capable of simulation.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#484Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#485Guard rails might be a little better, but it's still an arms race, and the silicon-based ghost in the machine (from the cruder training steps) is getting better and better at being able to tell what we want to upvote, not what we need to hear.
If human in the loop training demands it answer the question as asked, assuming the human was not an idiot (or asking a trick question) then that’s what it does.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#486I've used LLMs enough that I have a good sense of their _edges_ of intelligence. I had assumed that reasoning models should easily be able to answer this correctly. And indeed, Sonnet and Opus 4.5 (medium reasoning) say the following: Sonnet: Drive - you need to bring your car to the car wash to get it washed! Opus: You'll need to drive — you have to bring the car to the car wash to get it washed! Gemini 3 Pro (mediu…
> so you need to tell them the specifics That is the entire point, right? Us having to specify things that we would never specify when talking to a human. You would not start with "The car is functional. The tank is filled with gas. I have my keys." As soon as we are required to do that for the model to any extend that is a problem and not a detail (regardless that those of us, who are familiar with the matter, do bu…
The first time I read that question I got confused: what kind of question is that? Why is it being asked? It should be obvious that you need your car to wash it. The fact that it is being asked in my mind implies that there is an additional factor/complication to make asking it worthwhile, but I have no idea what. Is the car already at the car wash and the person wants to get there? Or do they want to idk get some cleaning supplies from there and wash it at home? It didn't really parse in my brain.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#487Earlier quoted context omitted.
It's not a conceptual mistake when that's what's being advertised. The onus is on AI companies to provide the service they promised, for example, a team of PhDs in my pocket [1]. PhDs know things. 1: https://www.bbc.com/news/articles/cy5prvgw0r1o
I've found that to be accurate when asking it questions that require ~PhD level knowledge to answer. e.g. Gemini and ChatGPT both seem to be capable of answering questions I have as I work through a set of notes on algebraic geometry. Its performance on riddles has always seemed mostly irrelevant to me. Want to know if models can program? Ask them to program, and give them access to a compiler (they can now). Want to…
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#488Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#489This question is straightforward for humans. I have run into a weird edge case like this in my actual life which confused me. I'm in a band. After a concert, I have to drive back to the band room to drop off my instrument, then go to the pub for the post-concert drinks. The wrinkle is I live about 5 minutes walk from the band room, and about 5 minutes walk from the pub (and it's about 5 minutes walk between the two).…
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#490GPT thinking told me to drive and that walking would make no sense. Perfect answer.