Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

First Impressions with GPT-4V(ision)

blog.roboflow.com

Post reply on HN
Print view View original

221–230 of 345 posts

Re: First Impressions with GPT-4V(ision)

#221

Post by p1esk »

cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

If the rate of improvement continues at the current pace - which is GPT 1 to 2 to 3 to 4 in the last five years - we are just one or two improvements away from a full blown AGI/superintelligence/singularity/etc. At that point, a superior user interface is probably the least interesting (or scary) thing that would happen.

I personally doubt GPT-5 will be as much of an improvement over GPT-4 as GPT-4 was over GPT-3, but that's fine, I can wait until GPT-6 or 7.

Re: First Impressions with GPT-4V(ision)

#222

Post by nimithryn »

dottjt wrote: post #18
famouswaffles wrote: post #11

Graph analysis is impressive (last example) - https://imgur.com/a/iOYTmt0 Can do UI to frontend. Seems to understand the UI graphical elements and layout, not just text https://twitter.com/skirano/status/1706823089487491469 Can describe comic images accurately, panel by panel - https://twitter.com/ComicSociety/status/1698694653845848544?... Lots of examples here also - https://www.reddit.com/r/ChatGPT/comments/16sdac…

Oh wow, I'm completely fucked as a front end developer.

I’ve used GPT4 (text) heavily as part of my business, including for front end stuff.

The technology is very impressive - but honestly Twitter examples are super cherry picked. Yeah, you can build some very ugly, basic front end web pages and functionality right out of the box. But if you want anything even slightly prettier or more complicated, I’ve found you need a human in the loop (even an outsourced dev is better). I’ve had GPT struggle with even basic back end stuff, or anything even a bit out of distribution. It also tends to give answers that are “correct” but functionally useless (hard to explain what I mean, but if you use it a lot you’ll run into this - basically it will give really generic advice when you want a specific answer. Like, sometimes if you provide it some code to find a bug, it will advise you to “write unit tests” and “log outputs” even if you specifically instruct it to find the bug).

Plus, in terms of capabilities, tools like Figma already have design to code functionalities you can use - so I don’t think this is really a change in usable functionality.

Of course, the tech will get better over time.

Re: First Impressions with GPT-4V(ision)

#223

Post by nimithryn »

Michelangelo11 wrote: post #195
troupo wrote: post #181

Earlier quoted context omitted.

> It will be able to do it even faster, better and more cheaply than a human can. Take what you did in the past year. Write down every product decision taken, every interaction with other teams figuring out APIs you had, all the infra where your code is running and how it was setup and changed, all the design iterations and changes that had to be implemented (especially if you have external partners demanding it). Ye…

So ... in this example, your job is continually feeding information to the AI from various sources. Why would the AI not be automatically hooked up to all those sources? Building a system that can do that is essentially trivial with the OpenAI API.

Have you tried to build a system like this? It’s not trivial

Re: First Impressions with GPT-4V(ision)

#224

Post by DrJaws »

p1esk wrote: post #221
cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

If the rate of improvement continues at the current pace - which is GPT 1 to 2 to 3 to 4 in the last five years - we are just one or two improvements away from a full blown AGI/superintelligence/singularity/etc. At that point, a superior user interface is probably the least interesting (or scary) thing that would happen. I personally doubt GPT-5 will be as much of an improvement over GPT-4 as GPT-4 was over GPT-3, bu…

chat-gpt at the end is a language model, not an real AI, it have limits and are huge

Re: First Impressions with GPT-4V(ision)

#225

Post by stri8ted »

Can somebody explain how this works, specifically for OCR? I understand images can be embedded into the same high dimensional space as text, but wouldn't this embedding fail to retain the exact words and sequence, since it is effectively compressed?

Re: First Impressions with GPT-4V(ision)

#227

Post by moffkalast »

p1esk wrote: post #221
cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

If the rate of improvement continues at the current pace - which is GPT 1 to 2 to 3 to 4 in the last five years - we are just one or two improvements away from a full blown AGI/superintelligence/singularity/etc. At that point, a superior user interface is probably the least interesting (or scary) thing that would happen. I personally doubt GPT-5 will be as much of an improvement over GPT-4 as GPT-4 was over GPT-3, bu…

It does make one wonder how it'll all play out in the coming decades. One way or another humans will eventually be unemployable for most of currently existing jobs.

Throughout history, the ruling elite had always relied on the rest of the population to make their food, do their work, and fight in their wars. This is the first time ever that they will no longer have any need for anyone else. Maybe climate change will conveniently do the culling for them...

Of course there's always that option that we end up in a post scarcity space utopia where machine produced wealth is distributed to all, but only deluded idealists can possibly still think that'll ever be a real option as we slink further into techno feudalism with every passing day.

Re: First Impressions with GPT-4V(ision)

#228

Post by stri8ted »

pier25 wrote: post #226

It can solve captchas. We're doomed. Joking aside, I wonder how we're going to prevent bots when AI can impersonate a user and fool any system.

You can't prevent it. The best you can do, is prove an account belongs to a human, and that the human only has a single account, via cryptographic ZK proofs + Government issued keys or some other proof of personhood scheme. Assuming this is enforced, it would limit most abuse, and the AI would essentially be acting as an agent on behalf of the user.

Re: First Impressions with GPT-4V(ision)

#229

Post by eiiot »

yeldarb wrote: post #19
GaggiX wrote: post #12

Earlier quoted context omitted.

Solving CAPTCHAs at the moment is more inexpensive using humans than using GPT-4 API.

If true, this is wild. I suppose a human could spend 10 seconds per Captcha, so they could do 360 per hour. Add some overhead for not being operating at peak performance every minute of every hour & call it 250. Let's say you can hire someone for $2, that works out to a bit over a penny per Captcha. I don't think OpenAI has published pricing for GPT-4 Vision yet, but if we assume it's on par with GPT-4, and uses only…

The way these work is usually presenting an existing captcha to another human who doesn’t even know they’re solving the captcha. For example, sites hosting pirated content serve fake captchas as a way to make money.

Re: First Impressions with GPT-4V(ision)

#230

Post by raincole »

yieldcrv wrote: post #40
Tostino wrote: post #23

Earlier quoted context omitted.

Your job will change in fundamental ways at least.

The more people say that, the less convincing it is There is no way I would have a UI developer onboarded when I can generate many iterations of layouts in midjourney, copy them into chatgpt4 and get code in NextJS with Typescript instantly non devs will have trouble doing this or thinking of the prompts to ask, but the dev team asking for headcount simply wont ask for headcount, and the engineering manager is going…

> when I can generate many iterations of layouts in midjourney, copy them into chatgpt4 and get code in NextJS with Typescript instantly

Have you actually tried this?

I did the first step and even that didn't work well. The "iterations of layout in MidJourney" step. If people can make it work, well bless them, but we're not getting rid of our graphic designer now.

Post reply on HN