Live data from Hacker News

Watching o3 guess a photo's location is surreal, dystopian and entertaining

simonwillison.net

51–60 of 453 posts

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#51
post #45

I don’t understand the “dystopian” angle. Maybe I’m just old, but I remember the wonder when the Internet made most knowledge available with a few keystrokes. Having deductive reasoning with the same convenience feels wonderful, not dystopian.

Accessible to anyone, superhuman levels of deductive reasoning to pick out your location from super minor details in an innocent photo? That could certainly be dystopian

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#52

Earlier quoted context omitted.

Even better, edit it and place a false location.

This is a good test - the salient point is that it is fine if the LLM is confused, or even gets it wrong! But what I suspect would happen is that it would confabulate details which aren't in the photo to justify the incorrect EXIF answer. This is not fine.

I agree that it is not fine to confabulate details that are not supported by the evidence.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#53
post #45

I don’t understand the “dystopian” angle. Maybe I’m just old, but I remember the wonder when the Internet made most knowledge available with a few keystrokes. Having deductive reasoning with the same convenience feels wonderful, not dystopian.

Think: "stalker".

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#55
This tool just makes it easier for weirdos to achieve their goals at stalking women and kids.

Crazy that this is even allowed.

Who the hell needs to know the precise location of a picture, besides law enforcement? A rough location is most of the time sufficient. Like a region, a state, or a landscape (e.g., when you see the Bing background pictures, it's nice to see where they were taken).

This tool will give a boost to all those creeps out there that can have access to one or two pictures.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#56

Why is it dystopian? It's a nice utility. The tool is just intelligence. Intelligence itself is not dystopian or utopian. It's what you use it for that makes it so.

I agree with you. The opposite opinion sounds psychotic and paranoid to me.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#57
post #37
post #32

Earlier quoted context omitted.

How do you “accidentally post a photo”?

A selfie with a snippet of building in the background might give away your location even if you think there's no way it could be locatable.

Did you somehow accidentally share a selfie?

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#58
post #14

Why is it dystopian? It's a nice utility. The tool is just intelligence. Intelligence itself is not dystopian or utopian. It's what you use it for that makes it so.

Those who say it is "utopian" are also okay with: "If you've got nothing to hide, you've got nothing to fear". It is dystopian.

Not everything has to be the best thing ever or worst thing ever.

Some things are just tools that will be used for both good and bad.

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#59

Why is it dystopian? It's a nice utility. The tool is just intelligence. Intelligence itself is not dystopian or utopian. It's what you use it for that makes it so.

please accidentally post an identifying photo of your neighborhood...

I live in Belltown, Seattle. Oh no! The world knows my neighborhood!

Re: Watching o3 guess a photo's location is surreal, dystopian and entertaining

#60
post #49

Earlier quoted context omitted.

My point is that dishonesty/misalignment doesn't make sense for o3, which is not capable of being honest because it's not capable of understanding what words mean. It's like saying a monkey at a typewriter is being dishonest if it happens to write a falsehood.

You seem to be saying that only sentient beings can lie, which is too semantic for my tastes. But AI models can certainly 1) provide incorrect information, and even 2) reason that providing incorrect information is the best course of action.

No, I think a non-sentient AI which is much more advanced than GPT could lie - I never said sentience, and the example I gave involved a monkey, which is sentient. The problem is transformer ANNs themselves are too stupid to lie.

In 2023 OpenAI co-authored an excellent paper on LLMs disseminating conspiracy theories - sorry, don't have the link handy. But a result that stuck with me: if you train a bidirectional transformer LLM where half the information about 9/11 is honest and half is conspiracy theories, it has a 50-50 chance of telling you one or the other if you ask about 9/11. It is not smart enough to tell there is an inconsistency. This extends to reasoning traces vs its "explanations": it does not understand its own reasoning steps and is not smart enough to notice if the explanation is inconsistent.

Post reply on HN