Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reimagining the mouse pointer for the AI era

deepmind.google

Post reply on HN
Print view View original

81–90 of 223 posts

Re: Reimagining the mouse pointer for the AI era

#84

Post by why_at »

concinds wrote: post #64
why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

The second half of your comment is a go-to-market concern but doesn't feel so relevant for a research prototype. It could be done with a private local model too, maybe not by Google. But I don't think the voice problem is surmountable. I closed their image editing demo when I saw it required a mic. It would be appealing as a Spotlight-like text pop-up interface where you type instructions, which would work in social/…

Yeah I think there could be something to the integration of AI in an operating system so that it can handle things going on in different applications the same way you can already copy and paste between things.

But if it's going to require phoning home to some Google/OpenAI/whoever then forget it. I don't want a constant connection to my OS from one of these companies.

Re: Reimagining the mouse pointer for the AI era

#86

Post by dwa3592 »

I tried it in ai studio and it was extremely disappointing. It did not follow the directions. I pointed at the door of the sand castle and said make the door of the sand castle bigger. it created another very big sand castle on the side. Then i pointed at one flag of the castle and said turn this flag into a blue flag. It turned two other random flags to blue but the one i pointed the pointer at.

Re: Reimagining the mouse pointer for the AI era

#88

Post by lorecore »

footy wrote: post #63

you can really tell the people building these tools spend a lot of time alone. I work from a home office 90% of the time and I wouldn't want this to be my workflow. I don't want to talk to my computer, I want to listen to music while I work, and I want to not sound deranged and disturb everyone around me when I am working from a coffeeshop or the open-plan office or the airport or the train or whatever. and that's as…

Agreed. A lot of Google products feel anti-social (like Google glass). They are definitely missing a human touch. Perhaps a byproduct of elitism and leet code grind filtering of employees mixed with founder personality.

Re: Reimagining the mouse pointer for the AI era

#89

Post by bonsai_spool »

joe5150 wrote: post #44
chromacity wrote: post #42

My reaction to the first demo (recipe) is that it was slower than typing the same thing on your keyboard. The second demo seems to be a wash: there's no time saved in saying "move this" versus "move crab". And an app-specific contextual menu would probably be faster. The third demo doesn't seem to warrant the use of a pointer at all, since there is only one way to interpret the prompt. None of this means that this ap…

Talking to your computer can only ever work for people in atomized work-from-home silos, surely. I can't really imagine living in a world where everybody is just muttering commands to the computer all the time.

This happens daily in radiology departments around the world
Post reply on HN