Live data from Hacker News

Watching o3 guess a photo's location is surreal, dystopian and entertaining

simonwillison.net

171–180 of 453 posts

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#171

I thought from this [0] that o3 makes up using python when it doesn't actually do so, or have I misunderstood or unduly trusted that link? [0] https://transluce.org/investigating-o3-truthfulness

You need to learn how to tell the difference between a syntax highlighted Markdown Python code block and Python that was passed through the Code Interpreter tool, but there is a visual difference. Executed Python displays on a black background.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#172
post #130

Earlier quoted context omitted.

I wonder if they have? My current intuition is that the US military / NSA etc have been just as suprised the explosion in capabilities of LLMs/transformers as everyone else. (I'm using "intuition" here as a fancy word for "dumb-ass guess".) I'd be interested to know if the NSA were running their own GPT-style models years before OpenAI started publishing their results.

You don't need a LLM to do this. A dedicated image->coords model would likely perform much better, and that's old school ML at this point.

Have you seen a description of one of those? I didn't know that those existed.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#173
post #95

Earlier quoted context omitted.

If you want to be impressed I suggest trying this yourself on your own photos. I don't consider it my job to impress or mind-blow people: I try to present as realistic as possible a representation of what this stuff can do. That's why I picked an example where its first guess was 200 miles off!

I'm not a computer. I expect a computer to also do better than me at memorizing the phone book, but I'm not impressed by it.

In that case, are you at all surprised that this technology did not exist two years ago?

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#174

Earlier quoted context omitted.

The tool is just intelligence. Intelligence itself is not dystopian or utopian. It's what you use it for that makes it so. If you don't want to post a photo, then don't post a photo.

>If you don't want to post a photo, then don't post a photo. Other people have posted photos of me without my consent, how am i meant to stop that? If i posted photos 20 years ago when i was a dumb teenager i cant undo that, either

Those are still the consequences of your own actions. If someone is so desperate to find you, there are easier ways. GeoGuessr isn't exactly super hard. If privacy is so important to you, it's all down to personal responsibility.

But this here? This is just drama over nothing.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#175
post #63

I play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations eit…

Super cool, man. Watching pro Geoguessr is my latest break-time activity, these geo-gods never cease to impress me. One thing I'm curious about - in high level play, how much of the meta involves knowing characteristics about the photography/equipment/etc. that Google used when they shot it? Frequently I'll watch rainbolt immediately know an African country from nothing but the road, is there something I'm missing?

I was a very casual GeoGuessr player for a few months — and I found it pretty remarkable how quickly (and without a lot of dedicated study time) you could learn a lot of tells of specific regions — and get reasonably good (certainly not pro good or anything, but good enough to the hit right country ~80% of the time).

Another thing is how many areas of the world have surprisingly distinct looks. In one of my early games, before I knew much about anything, I was dropped a trail in the woods. I’ve spent a fair amount of time hiking in Northern New England — and I could just tell immediately that’s where I was just from vibes (i.e. the look of the trees and the rocks) — not something I would have guessed I would have been able to recognize.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#176
post #63

I play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations eit…

I find this type of problem is what current AI is best at: where the actual logic isn't very hard, but it requires pulling together and assimilating a huge amount of fuzzy, known information from various sources They are, after all, information-digesters

It takes a lot of energy to compress the data. And a lot to actually extract something sensible. While you could just just optimize the single problem you have quite easily.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#177
post #63

I play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations eit…

I find this type of problem is what current AI is best at: where the actual logic isn't very hard, but it requires pulling together and assimilating a huge amount of fuzzy, known information from various sources They are, after all, information-digesters

Which also fits with how it performs at software engineering (in my experience). Great at boilerplate code, tests, simple tutorials, common puzzles but bad at novel and complex things.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#178
post #109
post #63

I play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations eit…

Did you include location metadata with the photos by chance? I’m pretty surprised by these results.

As a further test, I dropped the street view marker on a random point in the US, near Wichita, Kansas, here's the image:

https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04...

I fed it o3, here's the response:

https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04...

Nailed it.

There's no metadata there, and the reasoning it outputs makes perfect sense. I have no doubt it'll be tricky when it can be, but I can't see a way for it to cheat here.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#179

For all of the images I've tried, the base model (e.g. 4o) already has a ~95% accurate idea of where the photo is, and then o3 does so much tool use only to confirm its intuition from the base model and slightly narrow down. For OP's initial image, 4o in fact provides a more accurate initial guess of Carmel-by-the-Sea (d=~100mi The clue is in the CoT - you can briefly see the almost correct location as the very first…

4o is already really good. For most of the pictures I tried they gave comparable results. However for one image 4o was only able to narrow it down the the country level (even with your CoT prompt it listed three plausible countries) while o3 was able to narrow it down to the correct area in the correct city, being off by only about 500m. That's an impressive jump

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#180
post #173

Earlier quoted context omitted.

I'm not a computer. I expect a computer to also do better than me at memorizing the phone book, but I'm not impressed by it.

In that case, are you at all surprised that this technology did not exist two years ago?

Did it not, or no one was interested enough to build one? I’m pretty certain there’s a database of portraits somewhere where they search id details from photograph. Automatic tagging exists for photo software. I don’t see why that can be extrapolated to landmarks with enough data.
Post reply on HN