Live data from Hacker News

AI: First New UI Paradigm in 60 Years?

nngroup.com

161–170 of 219 posts

Re: AI: First New UI Paradigm in 60 Years?

#162

Here is how I think about it The LLM's are infinity app stores. All you need is an LLM and a database plus the ability to speak english and you can replace most features provided by SaaS services today. The GUI becomes a byproduct of the problem you want to solve rather than the gatekeeper to what you can solve. https://twitter.com/Hello_World/status/1660463528984150018?s...

I share this opinion as well, I think. I’m looking at any CRUD app I’ve worked on and thinking: this is just a specification over a database. Same with most other software but the web and most mobile apps seem ripe to just become generated patterns.

Re: AI: First New UI Paradigm in 60 Years?

#163

There's something ironic to me about the fact that building AI experiences still requires the first computing paradigm: batch processing. At least, my experience building a retrieval-augmented generation system requires a lot of batch processing. Well, I shouldn't say "requires". I'm sure you can build them without batch processing. But batch processing definitely felt like the most natural and straightforward way to…

He's talking about human-computer interaction paradigms, not computing paradigms. He's not a general computing expert, he's a UI/UX expert. "Batch computing" in this context refers to the era of punch cards, needing to wait for results overnight, and the difficulty of editing pre-existing programs -- and how all of that utterly dictated the style of interaction one had with computers.

Yep, I was aware of the difference before I made my original comment. There's still something ironic and interesting about it to me. Can't quite put my finger on it, though.

Re: AI: First New UI Paradigm in 60 Years?

#164

Earlier quoted context omitted.

Ok, now let's tackle a slightly tricker UI. Let's assume someone hasn't used Blender before. "Draw me a realistic looking doughnut, with a shiny top and pink sprinkles" Vs. 2 hour video tutorial to tell you what do 50 or so individual steps using the 2nd paradigm UI. Then clicking all the buttons. -- Admittedly, the AI approach robs you of understanding of how the sausage (sorry doughnut) is made. Rebuttal: Doughnut…

In the future it’ll likely be that doing it manually will be considered specialty work. This is already the case with much of programming — as you’d bring in a higher level engineer to do something like tear into the source code of SDKs and monkey with them. For something as “simple” as a doughnut, this will just improve the learning curve and let you learn some things a bit later, just like today you can jump into b…

Mere abstraction a bit different because with say JS you need to learn a skill. It is not easy for a non programmer to do well. Takes a lot of hours. Now or soon they will be telling the computer what they want for simple things. Userspace for non programmers is going to expand greatly.

Re: AI: First New UI Paradigm in 60 Years?

#165
post #44

The article fails to grasp the essence of what UI is actually about. I agree that AI is adding a new layer to UI and UX design. In our work [1] we have seen an increase in AI projects or features the last 12 months (for obvious reasons). However, the way that AI will contribute to better UI is to remove parts of the Interface. not simply giving it a new form. Let me explain, the ultimate UI is no UI. In a perfect sce…

You can't eliminate the UI if you want to be able to do more than one thing (e.g., order a pizza).

The UI should simply let you easily do what needs to be done.

Re: AI: First New UI Paradigm in 60 Years?

#166
post #56

What about voice assistants? These are not as impressive when compared to LLMs, so perhaps wouldn't cause a UX shift on their own. But in essence Siri, Alexa, etc also seem to put the user's intent first.

A voice assistant is simply a speech-driven conversational UI; they belong to the same class of UIs as chatGPT. In fact, you could very well power your voice assistant with GPT.

Re: AI: First New UI Paradigm in 60 Years?

#167
post #51

Earlier quoted context omitted.

Agreed. Also, Uber (and many other mobile apps) wouldn't work as a CLI or desktop GUI, so leaving out mobile is another stretch.

Why wouldn't apps like Uber work on the desktop?

The distinction between a 'mobile' UI and a desktop one is more to do with the difference between a client and an application. Which is of course one that's basically as old as computer networks.

Re: AI: First New UI Paradigm in 60 Years?

#168
post #47

Earlier quoted context omitted.

Agreed. Also, Uber (and many other mobile apps) wouldn't work as a CLI or desktop GUI, so leaving out mobile is another stretch.

That seems like a technology centered view. Nielsen is talking from the field of Human-Computer Interaction where he is pioneer, which deals with the point of view of human cognition. In terms of the logic of UI mechanics, what about mobile is different? Sure gestures and touch UI bring a kind of difference. Still, from the standpoint of cognition, desktop and mobile UIs have fundamentally the same cognitive dynamics…

Good CLIs don't make users remember commands by heart. Except at a very basic level. I often joke that the average Linux user only really needs three keys on their keyboard: Up, Enter and Tab. (Not strictly true, since sometimes you press ctrl-R, but that's a substitute for pressing Up a bunch of times.) Tab completion on many CLIs is good enough that I'm often frustrated when the tab key isn't the 'do what I'm thinking' button. And whenever browsers change their predictive text algorithms so I need to type more than three letters of a URL for it to complete, I get annoyed because I'm so used to the predictor knowing what I want. And I get the feeling that if Google doesn't autocomplete your query long before you're finished writing it, it's because you're not going to get any results for it anyway.

The implementation may be different, but expecting a computer to know what I want based on my or similar people's past behaviour rather than telling it exactly has been the norm for quite some time. Some of this is from humans using their experience to implement rules, and some of it is actually ML that predates the current LLM trend.

Re: AI: First New UI Paradigm in 60 Years?

#169

Earlier quoted context omitted.

> Both of those are systems which had to work right. Large language models are not even close to being safe to use in such applications. Until LLMs report "don't know" instead of hallucinating, they're limited to very low risk applications such as advertising and search. Are humans limited to low-risk applications like that? Because humans, even some of the most humble, will still assert things they THINK are true, b…

Can people please stop making this comment in reply to EVERY criticism of LLMs? "Humans are flawed too". We do not normally hallucinate. We are sometimes wrong, and sometimes are wrong about the confidence they should attach to their knowledge. But we do not simply hallucinate and spout fully confidence nonsense constantly. That is what LLMs. You remember a few isolated incidents because they're salient. That does no…

> We do not normally hallucinate. We are sometimes wrong, and sometimes are wrong about the confidence they should attach to their knowledge. But we do not simply hallucinate and spout fully confidence nonsense constantly. That is what LLMs.

In my average interaction with GPT 4 there are far less errors than in this paragraph. I would say that here you in fact "spout fully confidence nonsense" (sic).

Some humans are better than others at saying things that are correct, and at saying things with appropriately calibrated confidence. Some LLMs are better than some humans in some situations at doing these things.

You seem to be hung up on the word "hallucinate". It is, indeed, not a great word and many researchers are a bit annoyed that's the term that's stuck. It simply means for an LLM to state something that's incorrect as if it's true.

The times that LLMs do this do stand out, because "You remember a few isolated incidents because they're salient".

Re: AI: First New UI Paradigm in 60 Years?

#170
post #127
post #107

Earlier quoted context omitted.

Oh snap, did I just pull back the curtain?

You put into words the things I've noticed UIs evolving away from. It just feels like UIs of software 10,20, even 30 years ago were designed for "operators", people that actually worked with the software for hours at end, and so with a little bit of learning you could be dancing with keybindings and doing stuff as fast as CLI nerds. Nowadays most seems to be optimized for first hour of use of new user and not much el…

Downside is nowadays in office setting one has to operate 20+ different applications to get work done.

While as operator you would spend more like 80% of your time using the same interface and application.

I could spend my time to type 100WPM but I am not a typist - as a software dev it is quite enough to go with 40-60WPM because it is just small part of my work.

Post reply on HN