Live data from Hacker News

ChatGPT now performs well at GeoGuesser

flausch.social

91–100 of 152 posts

Re: ChatGPT now performs well at GeoGuesser

#91

Earlier quoted context omitted.

If you're going to make such an assertive statement you should maybe backup that claim with some substance. Without such, it's akin to an atheist proudly proclaiming there is definitely no such thing as god.

No, actually the person asserting that a thing exists has the burden of proof. You can demonstrate that the military has fighter jets better than civilians. Easy. You have no evidence at all that the military has super advanced AI systems consumers don't have. And in fact all anecdotal evidence for the past 3 years is that OSINT is as good or better than the DoD capabilities for photo analysis.

> No, actually the person asserting that a thing exists has the burden of proof.

Well, I'm not the one that made an assertion so I think both of you should provide some proof/evidence/support for your assertion. It doesn't matter if the assertion is for the existence of something or not. When you make an assertion you provide backing evidence to support it. Even for the assertion of nonexistence. This is basic stuff. Weird to even have to argue about it on HN. But just in case you never learned it, "There is no X" (your original assertion) is different from "There is no evidence for the existence of X".

> Easy. You have no evidence at all that the military has super advanced AI systems consumers don't have.

Okay I'll bite, we have access to project maven and knows exactly what it's capable of?

https://en.wikipedia.org/wiki/Project_Maven https://www.bloomberg.com/features/2024-ai-warfare-project-m...

Okay sure, whatever you say. You clearly are privy to all of the projects the government is involved with, and surely while all of the consumer AI capabilities have been released they've been sitting around doing nothing with it like a deer in headlights.

Consumer AI has more data available to train off of than the government....right?

I'm sure the government just threw away all their AI projects and bought a chatgpt pro subscription because it's better or the same as what they are using with all the same capabilities...

What a silly position to take. Why did everybody foolishly make such a big deal about all the data they were collecting all these years

Re: ChatGPT now performs well at GeoGuesser

#92

I gave it a series of 11 images stripped of all metadata. It performed quite well, only misidentifying the two taken in a small college town in the NE of the US. It got two questions correct on photos taken in Korea (one with a fairly clear view of Haneul Park, the other a rather difficult to identify picture not resembling anything on google of Sunrise Peak). It got every other question in the US correct, ranging fr…

I uploaded this image that I screenshotted off Google street view (no metadata) and it got with 200m. https://chatgpt.com/share/6801bbf7-fd40-8008-985d-75c8813f55... There is the chat. Weirdly it said, "I’ve seen that exact house before on Google Street View when exploring Cairns neighborhoods."

This was the image: https://imgur.com/a/cCUvgDG

Re: ChatGPT now performs well at GeoGuesser

#93

Earlier quoted context omitted.

I uploaded this image that I screenshotted off Google street view (no metadata) and it got with 200m. https://chatgpt.com/share/6801bbf7-fd40-8008-985d-75c8813f55... There is the chat. Weirdly it said, "I’ve seen that exact house before on Google Street View when exploring Cairns neighborhoods."

This is the most impressive ChatGPT chat I’ve seen yet. While I theoretically can accept how large-scale probabilistic text generation can lead to this chain of “reasoning”, it really feels like actual intelligence.

It's been intelligence for a long time; the goalposts just shift, and people can't abstract the idea to an LLM. But language processing and large data processing itself IS a form of intelligence.

Re: ChatGPT now performs well at GeoGuesser

#94

Earlier quoted context omitted.

No, actually the person asserting that a thing exists has the burden of proof. You can demonstrate that the military has fighter jets better than civilians. Easy. You have no evidence at all that the military has super advanced AI systems consumers don't have. And in fact all anecdotal evidence for the past 3 years is that OSINT is as good or better than the DoD capabilities for photo analysis.

> No, actually the person asserting that a thing exists has the burden of proof. Well, I'm not the one that made an assertion so I think both of you should provide some proof/evidence/support for your assertion. It doesn't matter if the assertion is for the existence of something or not. When you make an assertion you provide backing evidence to support it. Even for the assertion of nonexistence. This is basic stuff.…

That's kinda not how it works around here tho, I think? https://news.ycombinator.com/newsguidelines.html - we generally don't cross examine, and generally take people at their word, debate the merits sure, but it's not particularly done around here to say "prove it", at least from what I can tell.

Re: ChatGPT now performs well at GeoGuesser

#96
post #43

After trying with the free ChatGPT at least, I don't think this would be too much of an additional privacy risk. E.g. I submitted a photo I've taken with a feature with a particular architecture style in the front, and a city canal in the background, and told ChatGPT it was taken in China. It separated the feature and canal correctly, but still guessed wrong. I did remove the EXIF information, as ChatGPT tried to ext…

Have you tried this with o3? I think o3 is much better at this than any of the free models

o3 is a massive difference indeed; i just took a random picture outside my country house (so the house is not on there) in the middle of nowhere, removed all the meta info, set my vpn to the other side of the world and tried it; it guessed it very close from a few far away landmarks. Very impressive.

Re: ChatGPT now performs well at GeoGuesser

#97

I gave it a series of 11 images stripped of all metadata. It performed quite well, only misidentifying the two taken in a small college town in the NE of the US. It got two questions correct on photos taken in Korea (one with a fairly clear view of Haneul Park, the other a rather difficult to identify picture not resembling anything on google of Sunrise Peak). It got every other question in the US correct, ranging fr…

I gave It some photos from denmark, didn't even bother to strip the metadata. One is correctly said give of "Scandinavian vibes" every other photo was very wrong. I also gave it a photo of the french Alps, it guessed Switzerland.

Re: ChatGPT now performs well at GeoGuesser

#98

I gave it a series of 11 images stripped of all metadata. It performed quite well, only misidentifying the two taken in a small college town in the NE of the US. It got two questions correct on photos taken in Korea (one with a fairly clear view of Haneul Park, the other a rather difficult to identify picture not resembling anything on google of Sunrise Peak). It got every other question in the US correct, ranging fr…

I uploaded this image that I screenshotted off Google street view (no metadata) and it got with 200m. https://chatgpt.com/share/6801bbf7-fd40-8008-985d-75c8813f55... There is the chat. Weirdly it said, "I’ve seen that exact house before on Google Street View when exploring Cairns neighborhoods."

> Weirdly it said, "I’ve seen that exact house before on Google Street View when exploring Cairns neighborhoods."

That's slightly creepy!

Re: ChatGPT now performs well at GeoGuesser

#99
post #4

The Alki Beach example is absolute madness. On one hand, I can't wait until all thousands of my photos get automatic semantic and geographic tagging (I guess that's possible now). On the other, goodbye privacy, we hardly knew ye. It will be interesting to apply this to historical, or just old, photos.

>goodbye privacy, we hardly knew ye.

Don't upload your private photos anywhere.

Re: ChatGPT now performs well at GeoGuesser

#100

It wouldn’t shock me if multimodal LLMs were good at GeoGuesser [0], but if we’re being picky, it takes more than a few examples to demonstrate a game is “solved.” I also wonder what kind of data leakage might have been at play, like other people have suggested. To be clear, my point is not that this is unimpressive, just that this doesn’t demonstrate much. (Edit: I should have said, it doesn’t demonstrate what the t…

New title is pretty accurate: "now performs well". Another amenable HN solution.
Post reply on HN