Live data from Hacker News

First Impressions with GPT-4V(ision)

blog.roboflow.com

51–60 of 345 posts

Re: First Impressions with GPT-4V(ision)

#51
post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

I'm glad you made that change because the interface can't really solve every single thing. Most of what I do on my phone is read eBooks. AI can't inject the knowledge directly into my brain. Text on the screen is as good as it will get for the foreseeable future. Most of what I want to do in my home is cook, clean, sleep, and have sex with my wife. Software can't do any of those things for me. Most of what I want to…

Also, keep in mind that Robots may be scifi level in 2 years. Like, able to cook and clean with hands! Crazy, but I think we will see it happen so fast:

https://www.tri.global/news/toyota-research-institute-unveil...

Re: First Impressions with GPT-4V(ision)

#53

Earlier quoted context omitted.

So you won't be able to do anything without Internet connection to the AI mainframe? No thanks.

Only the stuff you don't know how to do yourself.

... like operate my phone without a UI?

Re: First Impressions with GPT-4V(ision)

#55

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

> Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? OpenAI’s example included bike repair and toolkit choice Allot of people could use this even if they aren’t right now

Don’t be ridiculous.

They’ll use YouTube, just like they do right now. Maybe if it could watch the video, then step you through it step by step. …but it cant, with what they’ve actually released here.

Oh whatever. If I’m wrong, I’m wrong. Time will tell.

Re: First Impressions with GPT-4V(ision)

#56
post #2

I’m intrigued to see what kind of problems it’s going to be good/bad at. I think it’s going to be tricky to evaluate though because it has probably memorized all the easy images to eval it with. Eg anything pulled from Google Images (like that Pulp Fiction frame or city skyline photo) is not a good test. It recognizes common shots but if you pull a screenshot from Google Maps or a random screen cap from the movie it…

It seems it will still be limited by its linguistic understanding of the surrounding context, at least in the first chicken sandwich picture.

Although its interpretation could make some sense but is also mostly wrong if talking about physical size of a modern GPU's main processor compared to the size of the associated VRAM chips. It has missed the joke entirely as far as I am aware. I think the joke is actual about Nvidia's handling of product segmentation, selling massive processors with less memory than is reasonable to pair them with on their consumer gaming offerings, while loading up the nearly identical chips with more memory for scientific and compute applications...

Re: First Impressions with GPT-4V(ision)

#57
post #29

Earlier quoted context omitted.

>> Who holds their phone up and takes a photo then wants to know it was a photo of? >> Great for the vision impaired. Yes, this is great for the estimated 285 million vision impaired people around the world[1]. [1] https://www.bemyeyes.com/about

Did you read my comment? I literally said that it’s for vision impaired. That’s great. …but it’s niche . I’m sitting on my couch right now and I can think of like 20 things I could chat to chatgpt about. I can see literally nothing in my visual range want to take a photo of and run image analysis over. It’s like Shazam. Yes, it’s useful, but, most of the time, I don’t need it. I would argue this is true for this, for…

baffling that you think 3.5% of the world's population is a niche

Re: First Impressions with GPT-4V(ision)

#60
post #18

Graph analysis is impressive (last example) - https://imgur.com/a/iOYTmt0 Can do UI to frontend. Seems to understand the UI graphical elements and layout, not just text https://twitter.com/skirano/status/1706823089487491469 Can describe comic images accurately, panel by panel - https://twitter.com/ComicSociety/status/1698694653845848544?... Lots of examples here also - https://www.reddit.com/r/ChatGPT/comments/16sdac…

Oh wow, I'm completely fucked as a front end developer.

Has AI been able to figure out conflicting and quickly changing product requirements and implement them on top of existing technical debt?

You'll be fine.

Post reply on HN