Do you hate the designer changed the UI of your favorite app so you have to relearn it every three months? Congrats! Now you need to relearn it every time you open the app.
Another way to think of this is you just ship the UI DSL, and the user can get the app to customize it themselves with built-in guardrails. Everything should be LCARS at this point.
OUI-1: world's first model for Generative UI
61–67 of 67 posts
Re: OUI-1: world's first model for Generative UI
#62Do you hate the designer changed the UI of your favorite app so you have to relearn it every three months? Congrats! Now you need to relearn it every time you open the app.
Re: OUI-1: world's first model for Generative UI
#63Re: OUI-1: world's first model for Generative UI
#64The most interesting part about this for me is that they decided to create their own language or DSL for the task at hand. So it's not just a large language model; it's an LLM with its own language. I have a feeling that the best AI systems to come will, in fact, be a complete package like this: a harness, a DSL, and an entire package designed to produce certain outcomes cheaper and faster. And producing that complet…
It too is just software
Re: OUI-1: world's first model for Generative UI
#65I think there is a big misunderstanding in the space around what Gen UI is and what its used for. Lots of folks refer to it as a framework for building web apps - its not. Gen UI is a DSL for LLM to build UIs on the fly in a multi turn converstation - those are - throw away, one off interfaces or visualization. The reason for the DSL is pragmatism - standardisation and token savings. The html/css/js or a react app bu…
...i like.
---
- Design system / Component lib
- Live view of what components, tokens, other things... on the left side of the screen.
- You're in the meeting and talking while talking and transcribing and doing the full duplex voice. You say, "Find what tables and customizations we have available" and the list starts to filter to tables and customizations.
- "Let's add that table to the page; left side; 3/4 width of page. Headers should be static for vertical scroll, ..."
- The table is added to the page.
- "Nah, i don't like it. Let's change that table component to have larger headers..."
yes, i like--let's see what Astra Pro pops out with.
Re: OUI-1: world's first model for Generative UI
#66I think there is a big misunderstanding in the space around what Gen UI is and what its used for. Lots of folks refer to it as a framework for building web apps - its not. Gen UI is a DSL for LLM to build UIs on the fly in a multi turn converstation - those are - throw away, one off interfaces or visualization. The reason for the DSL is pragmatism - standardisation and token savings. The html/css/js or a react app bu…
Oh... amazing. just had a vision of being able to be in a meeting and talk through an User Interface design / review, while in a zoom meeting or whatever. ...i like. --- - Design system / Component lib - Live view of what components, tokens, other things... on the left side of the screen. - You're in the meeting and talking while talking and transcribing and doing the full duplex voice. You say, "Find what tables and…
Having said that, imo, Gen UI only makes sens as a presentation layer - not controls. Unless LLM will be using a set of very well defined and homogenic components like table, forms, small widgets.
Re: OUI-1: world's first model for Generative UI
#67The most interesting part about this for me is that they decided to create their own language or DSL for the task at hand. So it's not just a large language model; it's an LLM with its own language. I have a feeling that the best AI systems to come will, in fact, be a complete package like this: a harness, a DSL, and an entire package designed to produce certain outcomes cheaper and faster. And producing that complet…
Why can't an AI be trained to generate "the whole package"? It too is just software
We haven't really understood what the limitations of LLMs are. And I do not know. But as a person who uses Fable and Sol regularly to design my own new programming language, they suck at the task of defining new systems coherently. So far no AI I have tried is good at defining new coherent systems well. I suspect it's because of the recursive problem of using it on its own output.
So, a human is still needed to define and write the sort of first genesis of the system, and then AI can take it once the problem has been defined. But defining the problem and using it on itself is what AI is really bad at (for now).