Well, he posed a wrong question (incomplete, without context of where the car is) and got a wrong answer. LLM is a tool, not a brain. Context means everything.
[deleted]
I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
31–40 of 998 posts
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#32Well, he posed a wrong question (incomplete, without context of where the car is) and got a wrong answer. LLM is a tool, not a brain. Context means everything.
This is what "AI" advertised to solve. It is a perfectly fine question.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#33It turns out the Turing test is alive and kicking, after all.
This would not be a good question, because a non-negligible percentage of humans would give a similar answer.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#34From the images in the link, Deepseek apparently "figured it out" by assuming the car to be washed was the car with you.
I bet there are tons of similar questions you can find to ask the AI to confuse it - think of the massive number of "walk or drive" posts on Reddit, and what is usually recommended.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#35Results testing with 4 levels of Gemini (Fast, Thinking, Pro, Pro + Deep Think): https://ruby.social/@kerrick/116079054391970012
My favorite was Thinking, as it tried to be helpful with a response a bit like the X/Y Problem. Pro was my second favorite: terse, while still explaining why. Fast sounded like it was about to fail, and then did a change-up explaining a legitimate reason I may walk anyways. Pro + Deep Think was a bit sarcastic, actually.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#36Grok:
>You should drive. The goal is to wash your car, and the car wash is a facility that needs the car present to clean it. Walking the 50 meters gets you there, but leaves the car behind—unwashed. Driving the 50 meters is the only way to actually accomplish the task. Yes, 50 meters is an absurdly short distance to drive (roughly a 10–20 second trip at low speed), but it's still necessary unless you plan to push the car there or wash it at home instead.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#37Well, he posed a wrong question (incomplete, without context of where the car is) and got a wrong answer. LLM is a tool, not a brain. Context means everything.
true it's human nature to assume context fill gaps in their own imagination. LLM is working as intended
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#38The funny thing is when I got my first car at 29 I had similar thoughts. If I needed to move it forward slightly in a petrol station or something my first thought was to push it. Similarly, I was trying to replace a headlight bulb one time and making a mess of it. I dropped a spring or something inside the headlight unit. I kept having this thought of just picking the car up and shaking it.
Nobody writes in depth about the mundane practicalities of using a car. Most people don't even think about it ever. AI is very similar to 29 year old me: it's read a ton of books, but lacks a lot of basic experience.
How will AI get this experience that you can't read in a book? How will it learn what kneeding dough feels like? Or how acceleration feels if your body is mostly water? Interesting times ahead...
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#39Okay, funny. What does it prove? Is this a more general issue? How would you make the model better?
For me this is just another hint on how careful one should be in deploying agents. They behave very unintuitively.
Re: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
#40I asked on LM Arena. I got two models I never heard of, and they split on whether I should walk or drive. Ernie 5.0 said I should walk, and then trash talked me for thinking about driving. Octopodus pointed out I had to drive to get my car to the car wash.