Some similar experiments, dating back as far as 1996:
Sketching Interfaces
11–20 of 34 posts
Re: Sketching Interfaces
#12Seeing things like this just make me want to get into ML. I'm sure there's a ton of complexity behind it but it seems that it just feels so rewarding.
And IMHO statistics is the all important base one needs to have to wield ML properly. For starters, one should know the difference between the using the OLS algorithm and Simple Linear Regression.
Re: Sketching Interfaces
#13Seeing things like this just make me want to get into ML. I'm sure there's a ton of complexity behind it but it seems that it just feels so rewarding.
And IMHO statistics is the all important base one needs to have to wield ML properly. For starters, one should know the difference between the using the OLS algorithm and Simple Linear Regression.
[deleted]
Re: Sketching Interfaces
#14I'd be inclined to agree with Adam Michela when he says design systems restrain creativity. It is the industrialization of user interfaces.
Re: Sketching Interfaces
#15A perfect example of several congruent technologies being combined in novel ways to create something that opens up entirely new ways of working. Design systems + ML computer vision. Incredible.
Re: Sketching Interfaces
#16This is really incredible.
I've always loved the idea of "box and arrow" programming for flows, but in practice the interface was always too cumbersome -- typing was faster.
But coming up with a design language that a human can sketch and a machine can interpret really breathes new life into that idea.
Love it!
Re: Sketching Interfaces
#17It's great!
Re: Sketching Interfaces
#18Correct me if I'm wrong but is this basically doing what Adobe & others have already done? The only difference I noticed is they're using a camera & image recognition as the input instead of the designer dragging & dropping 1 of the 150 components on to a digital canvas in a software application? I do get that it's a demo that shows the possibility. I just feel I'm missing something that makes this stand out. I did o…
In practice there's a big difference in thought process and workflow between drawing freehand on paper and flipping through a UI library with a drag and drop interface. I think this is true even if your task is just composing from the same well defined set of components. If they can actually pull this off it I can see it being very useful. And if it works really well in conjunction with other experiments currently on…
The recognized seems to be fixed to a limited UI language, so is it fair to call this freehand? Rather, there is palette that you access via roughly sketching out a predefined form.
This won’t be that useful for many designer sketches,l where the visual language is mostly undefined.
Re: Sketching Interfaces
#19I'd be inclined to agree with Adam Michela when he says design systems restrain creativity. It is the industrialization of user interfaces.
Roads certainly limit where one can drive, but the alternative is pretty disastrous.
As with anything: there is a time and place. Design systems are wildly powerful for scaling, creating a cohesive language across a brand or product, and moving quickly.
Just because you have a design system doesn't mean the buck stops there. You can keep building new roads if you know where it is you need to go that the existing roads won't take you.
Re: Sketching Interfaces
#20If I'd want to build something like this as a copy-paste nerd with some python experience, where would i start?