Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

First Impressions with GPT-4V(ision)

blog.roboflow.com

Post reply on HN
Print view View original

101–110 of 345 posts

Re: First Impressions with GPT-4V(ision)

#101

Post by pwython »

wokwokwok wrote: post #26

I’m impressed, technically, but this seems niche. Who holds their phone up and takes a photo then wants to know it was a photo of? That’s weird. If you don’t know what it is, wtf did you take photo? The obvious use here is natural language improvement / photo editing for photos, but this is just a stepping stone to that, and bluntly, as it stands… the examples really don’t shine… Great for the vision impaired. …not s…

> Who holds their phone up and takes a photo then wants to know it was a photo of?

There are several popular "r/whatisthis(x)" subreddits: whatisthisthing, whatisthisbug, whatisthisplant, whatisthissnake, whatisthisrock, etc.

And there are many phone apps that attempt to do the same thing, like CoinSnap to identify coins.

Re: First Impressions with GPT-4V(ision)

#102

Post by IKantRead »

layer8 wrote: post #28
cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

I don’t know, I hate the idea of having to hold a natural-language conversation with a computer in order to make use of its functionality. It feels like being one of those Futurama heads in a jar that can’t do anything by themselves.

> I hate the idea of having to hold a natural-language conversation with a computer in order to make use of its functionality.

I hate the idea of having to use a mouse to click on a visual GUI to navigate a file system in order to make use of its functionality.

It's less the case today, even among developers, but it wasn't that long ago that I remember that any serious technical user of a computer took it as a point of pride to touch the mouse as little as possible. They're also still correct in that thinking. The command line is a very powerful UI with lots of benefits and while the mouse makes navigating the OS easier it's still much more limited than command line usage.

Touch screen interfaces are another example of an easier UI that ultimately feels even more limited. But people still plug their iPad pros in to magic keyboard folios frequently.

Having worked with these tools everyday for awhile now the "AI will change UX" is such a better take than "AI will conquer the world!". AI does fundamentally open up new work flows and user experiences, many of which do over a lot of potential improvements over their predecessors.

At the same time I doubt we'll see a world where we don't end up using the command line for the majority of serious technical work.

Re: First Impressions with GPT-4V(ision)

#103

Post by Miraste »

cs702 wrote: post #38
verve_rat wrote: post #22

Earlier quoted context omitted.

They will be the best input mode to play flight sims? I am being a little facetious, but you made a bold claim.

You're right, for actually playing the sim, you'll likely need a game controller or something like that. I edited my comment. But keep in mind that during the sim, you'll be able to ask the computer what you want the plane to do, and the computer will magically make it happen on your display.

No one would want that in a flight sim unless real planes start working that way, which we should all hope they don't.

Re: First Impressions with GPT-4V(ision)

#104

Post by chx »

apexalpha wrote: post #94
hypertele-Xii wrote: post #89

Earlier quoted context omitted.

GPT-3 requires 700 gigabytes of GPU RAM. I'm looking at my cheapest computer components retailer listing a 48 gigabyte GPU at $5k. So to run the previous generation of GPT would cost me about $70k right now. When do you think I can expect to run GPT-4 on my consumer $device? :)

You are now where the GUI was in in 1986 or so.

and you think corporate will wait near forty years for tech to catch up? no, they will, indeed force you to be always online, leading to absolute and total surveillance where you voluntarily add dozens of mics and cameras to every home. if you thought telescreens a'la 1984 is bad, just wait.

Re: First Impressions with GPT-4V(ision)

#105

Post by lewhoo »

yieldcrv wrote: post #40
Tostino wrote: post #23

Earlier quoted context omitted.

Your job will change in fundamental ways at least.

The more people say that, the less convincing it is There is no way I would have a UI developer onboarded when I can generate many iterations of layouts in midjourney, copy them into chatgpt4 and get code in NextJS with Typescript instantly non devs will have trouble doing this or thinking of the prompts to ask, but the dev team asking for headcount simply wont ask for headcount, and the engineering manager is going…

> There is no way I would have a UI developer onboarded when I can generate many iterations of layouts in midjourney

I guess we have to face the music and say yeah, that's true. If the work doesn't need copyrights then this seems like the way to go.

Re: First Impressions with GPT-4V(ision)

#106

Post by mode80 »

mbb70 wrote: post #37

The "Why is this image funny?" test reminds me of https://karpathy.github.io/2012/10/22/state-of-computer-visi... In 10 years we went from "SoTA is so far from achieving this I don't even know where to start" to "That'll be $0.0004 per token and have a nice day"

Karpathy ends on a note of despair "Maybe I should just do a startup. I have a really cool idea for a mobile local social iPhone app." That's exactly the path his now-boss took to bring us this. :)

Re: First Impressions with GPT-4V(ision)

#107

Post by Loeffelmann »

steveads wrote: post #64

I use ChatGPT fairly frequently, but am frequently annoyed at how hesitant it is to answer any question that is somewhat subjective. From it's Pulp Fiction response: "...However, whether you personally consider "Pulp Fiction" a good movie depends on your taste in film." To avoid this noise I often add something like this to my queries "skip any preamble or qualifications about how x is subjective" and the results are…

My prompt to make ChatGPT useable:

Please always give a direct answer, without any additional explanations, disclaimers, expertise limitations, or guidelines on human interaction. Be terse. Do not offer unprompted advice or clarifications. Remain neutral on all topics. Never apologize.

Re: First Impressions with GPT-4V(ision)

#108

Post by sottol »

cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

Everyone is going to wfh then or employers are going to splurge on a private office for everyone? Or is work basically going to be like a call center when everyone RTOs?

How does this work on public transit?

Re: First Impressions with GPT-4V(ision)

#109

Post by crazygringo »

cs702 wrote: post #10

Sure, there are a few edge-case failures and mistakes here and there, but I can't help but be in awe . AWE. Let me state the obvious, in case anyone here isn't clear about the implications: If the rate of improvement of these AI models continues at the current pace, they will become a superior user interface to almost every thing you want to do on your mobile phone, your tablet, your desktop computer, your car, your…

> they will become a superior user interface to almost every thing you want to do

No they won't. They're actually a pretty terrible user interface from a design perspective.

Primarily because they provide zero affordances, but also because of speed.

UX is about providing an intuitive understanding of available capabilities at a glance, and allowing you to do things with a single tap that then reflect the new state back to you (confirming the option was selected, confirming the process is now starting).

Where AI is absolutely going to shine is as a helpful assistant in learning/using those interfaces, much as people currently go to Google to ask, "how do I do a hanging indent in Microsoft Word for my Works Cited page"? For one-off things you do infrequently, that's a godsend, don't get me wrong. But it's not going to replace UI, it's going to assist.

And the 99% of your tasks that are repetitive habit will continue to be through traditional UI, because it's so much more efficient. (Not to mention that a lot of the time most people are not in an environment where it's polite or possible to be using a voice interface at all.)

Re: First Impressions with GPT-4V(ision)

#110

Post by travoc »

RandomLensman wrote: post #84
mbil wrote: post #71

Earlier quoted context omitted.

I agree. I think apps that would initially benefit from LLM-powered conversational interfaces are those that have the following traits: - constrained context - part of a hands-free workflow A couple use-cases I have been pondering are driving assistant and cooking assistant. People are already used to using their phone or car's nav system to give them directions to an unfamiliar place. But even with such a system it'…

In the cooking example, you either need the AI to have full awareness of the step you are at or you need to describe the step you are at, which could be cumbersome ("I did ..., how much sugar do I need now"). I venture, having the recipe projected in front of you would be much faster.

and a piece of paper wins again.
Post reply on HN