AI: First New UI Paradigm in 60 Years?
161–170 of 219 posts
Re: AI: First New UI Paradigm in 60 Years?
#162Here is how I think about it The LLM's are infinity app stores. All you need is an LLM and a database plus the ability to speak english and you can replace most features provided by SaaS services today. The GUI becomes a byproduct of the problem you want to solve rather than the gatekeeper to what you can solve. https://twitter.com/Hello_World/status/1660463528984150018?s...
Re: AI: First New UI Paradigm in 60 Years?
#163There's something ironic to me about the fact that building AI experiences still requires the first computing paradigm: batch processing. At least, my experience building a retrieval-augmented generation system requires a lot of batch processing. Well, I shouldn't say "requires". I'm sure you can build them without batch processing. But batch processing definitely felt like the most natural and straightforward way to…
He's talking about human-computer interaction paradigms, not computing paradigms. He's not a general computing expert, he's a UI/UX expert. "Batch computing" in this context refers to the era of punch cards, needing to wait for results overnight, and the difficulty of editing pre-existing programs -- and how all of that utterly dictated the style of interaction one had with computers.
Re: AI: First New UI Paradigm in 60 Years?
#164Earlier quoted context omitted.
Ok, now let's tackle a slightly tricker UI. Let's assume someone hasn't used Blender before. "Draw me a realistic looking doughnut, with a shiny top and pink sprinkles" Vs. 2 hour video tutorial to tell you what do 50 or so individual steps using the 2nd paradigm UI. Then clicking all the buttons. -- Admittedly, the AI approach robs you of understanding of how the sausage (sorry doughnut) is made. Rebuttal: Doughnut…
In the future it’ll likely be that doing it manually will be considered specialty work. This is already the case with much of programming — as you’d bring in a higher level engineer to do something like tear into the source code of SDKs and monkey with them. For something as “simple” as a doughnut, this will just improve the learning curve and let you learn some things a bit later, just like today you can jump into b…
Re: AI: First New UI Paradigm in 60 Years?
#165The article fails to grasp the essence of what UI is actually about. I agree that AI is adding a new layer to UI and UX design. In our work [1] we have seen an increase in AI projects or features the last 12 months (for obvious reasons). However, the way that AI will contribute to better UI is to remove parts of the Interface. not simply giving it a new form. Let me explain, the ultimate UI is no UI. In a perfect sce…
The UI should simply let you easily do what needs to be done.
Re: AI: First New UI Paradigm in 60 Years?
#166What about voice assistants? These are not as impressive when compared to LLMs, so perhaps wouldn't cause a UX shift on their own. But in essence Siri, Alexa, etc also seem to put the user's intent first.
Re: AI: First New UI Paradigm in 60 Years?
#167Earlier quoted context omitted.
Agreed. Also, Uber (and many other mobile apps) wouldn't work as a CLI or desktop GUI, so leaving out mobile is another stretch.
Why wouldn't apps like Uber work on the desktop?
Re: AI: First New UI Paradigm in 60 Years?
#168Earlier quoted context omitted.
Agreed. Also, Uber (and many other mobile apps) wouldn't work as a CLI or desktop GUI, so leaving out mobile is another stretch.
That seems like a technology centered view. Nielsen is talking from the field of Human-Computer Interaction where he is pioneer, which deals with the point of view of human cognition. In terms of the logic of UI mechanics, what about mobile is different? Sure gestures and touch UI bring a kind of difference. Still, from the standpoint of cognition, desktop and mobile UIs have fundamentally the same cognitive dynamics…
The implementation may be different, but expecting a computer to know what I want based on my or similar people's past behaviour rather than telling it exactly has been the norm for quite some time. Some of this is from humans using their experience to implement rules, and some of it is actually ML that predates the current LLM trend.
Re: AI: First New UI Paradigm in 60 Years?
#169Earlier quoted context omitted.
> Both of those are systems which had to work right. Large language models are not even close to being safe to use in such applications. Until LLMs report "don't know" instead of hallucinating, they're limited to very low risk applications such as advertising and search. Are humans limited to low-risk applications like that? Because humans, even some of the most humble, will still assert things they THINK are true, b…
Can people please stop making this comment in reply to EVERY criticism of LLMs? "Humans are flawed too". We do not normally hallucinate. We are sometimes wrong, and sometimes are wrong about the confidence they should attach to their knowledge. But we do not simply hallucinate and spout fully confidence nonsense constantly. That is what LLMs. You remember a few isolated incidents because they're salient. That does no…
In my average interaction with GPT 4 there are far less errors than in this paragraph. I would say that here you in fact "spout fully confidence nonsense" (sic).
Some humans are better than others at saying things that are correct, and at saying things with appropriately calibrated confidence. Some LLMs are better than some humans in some situations at doing these things.
You seem to be hung up on the word "hallucinate". It is, indeed, not a great word and many researchers are a bit annoyed that's the term that's stuck. It simply means for an LLM to state something that's incorrect as if it's true.
The times that LLMs do this do stand out, because "You remember a few isolated incidents because they're salient".
Re: AI: First New UI Paradigm in 60 Years?
#170Earlier quoted context omitted.
Oh snap, did I just pull back the curtain?
You put into words the things I've noticed UIs evolving away from. It just feels like UIs of software 10,20, even 30 years ago were designed for "operators", people that actually worked with the software for hours at end, and so with a little bit of learning you could be dancing with keybindings and doing stuff as fast as CLI nerds. Nowadays most seems to be optimized for first hour of use of new user and not much el…
While as operator you would spend more like 80% of your time using the same interface and application.
I could spend my time to type 100WPM but I am not a typist - as a software dev it is quite enough to go with 40-60WPM because it is just small part of my work.