Live data from Hacker News

Watching o3 guess a photo's location is surreal, dystopian and entertaining

simonwillison.net

311–320 of 453 posts

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#312
post #291
post #262

Earlier quoted context omitted.

My guess is that those questions are very typical and follow very normal patterns and use well established processes. Give it something weird and it'll continuously trip over itself. My current project is nothing too bizarre, it's a 3D renderer. Well-trodden ground. But my project breaks a lot of core assumptions and common conventions, and so any LLM I try to introduce—Gemini 2.5 Pro, Claude 3.7 Thinking, o3—they al…

> Give it something weird and it'll continuously trip over itself. And so will almost all humans. It's weird how people refuse to ascribe any human-level intelligence to it until it starts to compete with the world top elite.

Yeah, but humans can be made to understand when and how they're wrong and narrow their focus to fixing the mistake.

LLMs apologize and then proudly present the exact same output as before, repeatedly, forever spinning their wheels at the first major obstacle to their reasoning.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#314
post #209

Tried the same, results made me laugh. Completely clueless. I've seen passing prompts 8 about how it's not in the city I am and yet it tries again and again. My favourite moment was when it started analysing piece of blurry asphalt. After 6 minutes o3 it was confidently wrong: https://imgur.com/a/jYr1fz1 IMO not-in-US is actually great test if something was in LLMs data and the whole search is a for show.

I'm surprised to hear that. I keep running tests and the results are incredible, not only in the US. For example, here's a screenshot from a random location I found in Google Street View in Jordan: https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04... And here's o3 nailing it: https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04... Maybe using Google Street View images, zoomed out, tends to give mor…

Perhaps Google Street View is in the training set? These companies have basically scraped everything they can, I don't see any reason to believe they'd draw the line at scraping each other, and GSV is a treasure trove of labeled data.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#315
post #63

I play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations eit…

And yet many will continue to confidently declare that this is nothing more than fancy autocomplete stochastic parrots.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#316

Earlier quoted context omitted.

> weird people will do weird stuff regardless of technology If I were someone's only stalker, I'd be absolutely hopeless at finding their location from images. I'm really bad at it if I don't know the location first hand But now, suddenly with AI I'm close to an expert. The accessibility of just uploading an image to ChatGPT means everyone has an easy way of abusing it, not just a small percentage of the population

So I guess the evil we're worried about is stalkers who are bad at guessing locations, bad enough with tech that they don't know about geoguessr websites and subreddits, but good enough with tech to use LLMs?

Screenshot / save photo -> add to chatgpt chat -> "where is this taken?"

There couldn't possibly be a lower barrier to doing that

ChatGPT is also currently the #1 free app on ios and android in the US. Hardly a niche tool only tech people know about, compared to the 129k people on that subreddit

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#317
I tested on this image: https://imgur.com/a/YSoMBc1

It nailed it down to the exact park in Lisbon: https://maps.app.goo.gl/vpvqA14TCbeFb3Rd7

> The little clues that make me lean that way are the Portuguese-language exercise sign (“Abdominais”), the classic calçada portuguesa cobblestone path, the style of the outdoor-gym equipment the city installs, and—biggest tell—the long red-and-white neoclassical façade in the background, which looks just like the Nova Medical School building that borders that square.

I had forgotten the medical school!

It's not perfect, it thought this was in KL Malaysia: https://imgur.com/a/fbSDqyp (it's Bangkok Thailand)

> My hunch this time: the covered pedestrian sky-bridge that links Pavilion Bukit Bintang to the Kuala Lumpur Convention Centre / Suria KLCC in downtown Kuala Lumpur, Malaysia. The things that tipped me off are the distinctive white-panel ceiling and slim columns of that air-conditioned walkway, the glass balustrades, the vertical “PAVILION” banner glimpsed on the right, and the big LED façade of Pavilion Mall visible off to the left.

The sign on the right is part of the text Central World, which is a prominent mall in Bangkok.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#318
post #291
post #262

Earlier quoted context omitted.

My guess is that those questions are very typical and follow very normal patterns and use well established processes. Give it something weird and it'll continuously trip over itself. My current project is nothing too bizarre, it's a 3D renderer. Well-trodden ground. But my project breaks a lot of core assumptions and common conventions, and so any LLM I try to introduce—Gemini 2.5 Pro, Claude 3.7 Thinking, o3—they al…

> Give it something weird and it'll continuously trip over itself. And so will almost all humans. It's weird how people refuse to ascribe any human-level intelligence to it until it starts to compete with the world top elite.

A human can play tictactoe or any other simple game in a few minutes after being described the game. AI will do all kinds on interesting things that either are against the rules or will be extremely poor choices.

Yeah, I tried playing tictactoe with chatGPT and it did not do well.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#319

Earlier quoted context omitted.

Super cool, man. Watching pro Geoguessr is my latest break-time activity, these geo-gods never cease to impress me. One thing I'm curious about - in high level play, how much of the meta involves knowing characteristics about the photography/equipment/etc. that Google used when they shot it? Frequently I'll watch rainbolt immediately know an African country from nothing but the road, is there something I'm missing?

I was a very casual GeoGuessr player for a few months — and I found it pretty remarkable how quickly (and without a lot of dedicated study time) you could learn a lot of tells of specific regions — and get reasonably good (certainly not pro good or anything, but good enough to the hit right country ~80% of the time). Another thing is how many areas of the world have surprisingly distinct looks. In one of my early gam…

I went to watch the Minecraft movie, and when the scene where they arrive outside their new house came on I was like... that feels so much like New Zealand. Then a few weeks later I went to visit my mum in Huntly, and she was like "oh yeah, they filmed part of it in Huntly!".

So, yeah vibes are a real thing.

Post reply on HN