Live data from Hacker News

First Impressions with GPT-4V(ision)

blog.roboflow.com

41–50 of 345 posts

Re: First Impressions with GPT-4V(ision)

#41

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

One application can be objects recognition in security camera

Re: First Impressions with GPT-4V(ision)

#43

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

> who takes a photo then wants to know it was a photo of?

I find myself doing this rather frequently. The scenario described in the article is quite common for me: capturing a photo of a plant and utilizing an existing classification service to determine its identity. It could be driven by mere curiosity or practical concerns like identifying whether a plant is poison ivy.

Wildlife identification also falls into this category. Recognizing different bird species can be challenging, especially when it's not a familiar species like a blue jay. I often find myself engaging in this activity quite regularly!

EDIT: I should also point out this happens with other forms of ‘unknown object identification’. There’s an entire subreddit that’s quite popular devoted to just crowd-sourcing identification based on a picture.

Re: First Impressions with GPT-4V(ision)

#44
post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

Generally agree.

Just to play devils advocate:

If you want something done right, sometimes you have to do it yourself. Employees are sort of a universal UI. But you will always know more about what you want done than your agent, whether it’s human or computer. That’s even before considering the principal agent problem.

Re: First Impressions with GPT-4V(ision)

#45

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

> Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo?

OpenAI’s example included bike repair and toolkit choice

Allot of people could use this even if they aren’t right now

Re: First Impressions with GPT-4V(ision)

#46
post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

So you won't be able to do anything without Internet connection to the AI mainframe? No thanks.

Only the stuff you don't know how to do yourself.

Re: First Impressions with GPT-4V(ision)

#47
The discrepancy between the two answers regarding the set of coins is jarring. From the answer to the first question, one would assume that it can’t tell the currency. The answer to the second question shows that it actually can. The fact that LLMs don’t reflect a consistent inner model in that way, and hence the users’ inability to adequately reason about their AI interlocutor, is currently a severe usability issue.

Re: First Impressions with GPT-4V(ision)

#48
post #19
post #12

Earlier quoted context omitted.

Solving CAPTCHAs at the moment is more inexpensive using humans than using GPT-4 API.

If true, this is wild. I suppose a human could spend 10 seconds per Captcha, so they could do 360 per hour. Add some overhead for not being operating at peak performance every minute of every hour & call it 250. Let's say you can hire someone for $2, that works out to a bit over a penny per Captcha. I don't think OpenAI has published pricing for GPT-4 Vision yet, but if we assume it's on par with GPT-4, and uses only…

You'd be surprised, or perhaps horrified, by how cheap (self-proclaimed) human-based captcha solving services are.

If you just search for "captcha solving service" the first few results that come up offer 1000 solves of text-based captchas for Whether these are actually human based, or just impressive OCR services, it seems like they are still much more cost effective than GPT-4 is for now.

Re: First Impressions with GPT-4V(ision)

#49

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

I'm bookmarking this and filing it alongside the infamous hacker news dropbox comment:

https://news.ycombinator.com/item?id=9224

Re: First Impressions with GPT-4V(ision)

#50

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

it's still a good PoC for robots?
Post reply on HN