Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

First Impressions with GPT-4V(ision)

blog.roboflow.com

Post reply on HN
Print view View original

131–140 of 345 posts

Re: First Impressions with GPT-4V(ision)

#131

Post by digging »

wokwokwok wrote: post #36
otoburb wrote: post #29

Earlier quoted context omitted.

>> Who holds their phone up and takes a photo then wants to know it was a photo of? >> Great for the vision impaired. Yes, this is great for the estimated 285 million vision impaired people around the world[1]. [1] https://www.bemyeyes.com/about

Did you read my comment? I literally said that it’s for vision impaired. That’s great. …but it’s niche . I’m sitting on my couch right now and I can think of like 20 things I could chat to chatgpt about. I can see literally nothing in my visual range want to take a photo of and run image analysis over. It’s like Shazam. Yes, it’s useful, but, most of the time, I don’t need it. I would argue this is true for this, for…

> I’m sitting on my couch right now and ... I can see literally nothing in my visual range want to take a photo of and run image analysis over.

What if you weren't on your couch? Going outside is not "niche".

Re: First Impressions with GPT-4V(ision)

#132

Post by bamboozled »

yieldcrv wrote: post #40
Tostino wrote: post #23

Earlier quoted context omitted.

Your job will change in fundamental ways at least.

The more people say that, the less convincing it is There is no way I would have a UI developer onboarded when I can generate many iterations of layouts in midjourney, copy them into chatgpt4 and get code in NextJS with Typescript instantly non devs will have trouble doing this or thinking of the prompts to ask, but the dev team asking for headcount simply wont ask for headcount, and the engineering manager is going…

Will you then use the AI to scale your platform ? Optimise your database ? Improve your test coverage, implement new features, write new backend services, integrate with old difficult but critical systems?

At some stage you must realise that you’re still working…

Re: First Impressions with GPT-4V(ision)

#133

Post by yieldcrv »

bamboozled wrote: post #132
yieldcrv wrote: post #40

Earlier quoted context omitted.

The more people say that, the less convincing it is There is no way I would have a UI developer onboarded when I can generate many iterations of layouts in midjourney, copy them into chatgpt4 and get code in NextJS with Typescript instantly non devs will have trouble doing this or thinking of the prompts to ask, but the dev team asking for headcount simply wont ask for headcount, and the engineering manager is going…

Will you then use the AI to scale your platform ? Optimise your database ? Improve your test coverage, implement new features, write new backend services, integrate with old difficult but critical systems? At some stage you must realise that you’re still working…

put our two comments into an LLM and ask if it these are even related thoughts

because at least it will have actually read my comment

Re: First Impressions with GPT-4V(ision)

#134

Post by rocauc »

kaibee wrote: post #115
jihadjihad wrote: post #85

Earlier quoted context omitted.

Has anyone tried GPT-4V on that image?

This image (and the text around it) is certainly already in the training data. Need to create that scenario from scratch with some grad students and then try it.

+1

Re: First Impressions with GPT-4V(ision)

#135

Post by sandbags »

hypertele-Xii wrote: post #89
op00to wrote: post #65

Earlier quoted context omitted.

Until the AI mainframe runs on your $device

GPT-3 requires 700 gigabytes of GPU RAM. I'm looking at my cheapest computer components retailer listing a 48 gigabyte GPU at $5k. So to run the previous generation of GPT would cost me about $70k right now. When do you think I can expect to run GPT-4 on my consumer $device? :)

I would be surprised if GPT-3 uses 700GB of RAM. It may be true, I don't know. But I am running 70B parameter models (quantized to 5 or 6 bits, biggest is 48GB loaded) on my 64GB Mac M2 Max Studio now and they are usable and the machine is still usable too. With an M2 Ultra and 192GB of RAM I imagine you could do a lot more.

I'm not arguing that these models hold up against GPT 3.5 and I still use GPT 4 when it matters. But they work and it's more like the difference between Premier League & Division 1, rather than PL & a five-a-side team from Bracknell.

Even a few years ago I could not have imagined this.

Given the pace of work on optimisation and my assumption that the M3 Studio I buy next will probably have 256GB of RAM at much the same power levels as I use now, it seems eminently possible it's a year or two away.

Re: First Impressions with GPT-4V(ision)

#136

Post by bratbag »

crazygringo wrote: post #109
cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

> they will become a superior user interface to almost every thing you want to do No they won't. They're actually a pretty terrible user interface from a design perspective. Primarily because they provide zero affordances, but also because of speed. UX is about providing an intuitive understanding of available capabilities at a glance, and allowing you to do things with a single tap that then reflect the new state ba…

If something is a repetitive habit that you can do almost without thinking, there is a good chance an AI could infer that entire chain.

I think what's more likely is that an AI based interface will end up being superior after it has had a chance to observe your personal preferences and approach on a conventional UI.

So both will still be needed, with an AI helping at the low end and high end of experience and the middle being a training zone as it learns you.

Re: First Impressions with GPT-4V(ision)

#137

Post by bamboozled »

yieldcrv wrote: post #133
bamboozled wrote: post #132

Earlier quoted context omitted.

Will you then use the AI to scale your platform ? Optimise your database ? Improve your test coverage, implement new features, write new backend services, integrate with old difficult but critical systems? At some stage you must realise that you’re still working…

put our two comments into an LLM and ask if it these are even related thoughts because at least it will have actually read my comment

I’m going to say you edited or amended you comment because that second paragraph wasn’t there , if it was. I was so underwhelmed with the first I guess I didn’t bother with the second.

Re: First Impressions with GPT-4V(ision)

#138

Post by yieldcrv »

bamboozled wrote: post #137
yieldcrv wrote: post #133

Earlier quoted context omitted.

put our two comments into an LLM and ask if it these are even related thoughts because at least it will have actually read my comment

I’m going to say you edited or amended you comment because that second paragraph wasn’t there , if it was. I was so underwhelmed with the first I guess I didn’t bother with the second.

my comment is over 3 hours old, it is not possible to have edited by the time you wrote yours

Re: First Impressions with GPT-4V(ision)

#139

Post by edgyquant »

morkalork wrote: post #73
layer8 wrote: post #28

Earlier quoted context omitted.

I don’t know, I hate the idea of having to hold a natural-language conversation with a computer in order to make use of its functionality. It feels like being one of those Futurama heads in a jar that can’t do anything by themselves.

UIs being dumbed down for average users was already annoying. Apparently the process won't stop until the illiterate are included too.

Ideally it won’t stop until computers are something we rarely think about. For me I love the CLI but having to use a mouse is a drag and causes serious wrist pain at this point in my life. Typing on a keyboard and clicking with a mouse are not the end all, be all of interacting with information systems.

Re: First Impressions with GPT-4V(ision)

#140

Post by throw1234651234 »

cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

Zero awe. This week so far it can't find an import of a type in Next.js and it can't get the user object from a session. Next.js is one of the most popular FE frameworks in the world. It lied about both, repeatedly giving wrong answers.

Here is my previous experience https://news.ycombinator.com/item?id=34648167 with it not being able to do basic tasks.

It's all fun and games until the mistakes start having a cost.

Other examples: I resorted to using it to order lists for me or adding quotes and commas to them for SQL inserts and such. Nope - when I look at the row count, it somehow drops values at random.

Post reply on HN