Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reimagining the mouse pointer for the AI era

deepmind.google

Post reply on HN
Print view View original

151–160 of 223 posts

Re: Reimagining the mouse pointer for the AI era

#151

Post by jeswin »

jasonjayr wrote: post #149
why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

The killer app was conceived as early as the 1980s: an agent running on your computer, organizing your files, your schedule, your messages, your bills, bank accounts, etc. All the parts of your life that were routine drudgery should be able to be offloaded to a smart agent, based on your preference, to bring you the information you needed with natural language queries, contextualized to what you were doing at the tim…

A few decades back, a lot of computer use was emails. And it was stored on someone else's servers - with everyone from server operators along the route, to the government potentially having access to it. Even HTTPS is a relatively recent thing.

I guess what I'm saying is - we've always had this problem.

Re: Reimagining the mouse pointer for the AI era

#152

Post by bitwize »

rhet0rica wrote: post #147
tintor wrote: post #12

Of course, it isn't a Google Demo, if you can't use it to book a table at restaurant. (shown at the bottom of the page)

My thoughts exactly. Why the fuck is this the primary concern of EVERY person who works at Google?!

Aside from work—commerce, entertainment, and social communication are pretty much the only things most normies will ever use a computer for. Maybe light accounting and scheduling as well. This has been true since the 90s when the normie market for computers opened way up due to the internet becoming widely available, and companies have been demoing commercial applications for their equipment and software since then if not even before. Ordering food for delivery was the big one back then. Here's Jennifer Aniston and Matthew Perry ordering Chinese via fax with the new Windows 95 in 1995: https://www.youtube.com/watch?v=vLlWrt-zmTo&t=685s

I'm sure Don Hopkins can tell you a long annotated tale about the NeWS pizza ordering app that displayed a real-time dynamically-updated rotating pie on the screen as you filled out your order.

Re: Reimagining the mouse pointer for the AI era

#153

Post by SilverSurfer972 »

If we want to close Human Machine loop as much as possible(pre-neuralink).

Assuming that today the most efficient way for human to transfer information to machines is via voice. Assuming for machines to convey rich information to humans that's by printing html.

Then a combination of screen + eye tracking + voice is all you need. The mouse doesn't make sense anymore.

Links: https://x.com/trq212/status/2052809885763747935

Re: Reimagining the mouse pointer for the AI era

#154

Post by MaxfordAndSons »

jeswin wrote: post #151
jasonjayr wrote: post #149

Earlier quoted context omitted.

The killer app was conceived as early as the 1980s: an agent running on your computer, organizing your files, your schedule, your messages, your bills, bank accounts, etc. All the parts of your life that were routine drudgery should be able to be offloaded to a smart agent, based on your preference, to bring you the information you needed with natural language queries, contextualized to what you were doing at the tim…

A few decades back, a lot of computer use was emails. And it was stored on someone else's servers - with everyone from server operators along the route, to the government potentially having access to it. Even HTTPS is a relatively recent thing. I guess what I'm saying is - we've always had this problem.

Yea there have always been gaps in privacy, but nowadays it's several orders of magnitude easier for corporations to exploit that private data at scale.

Re: Reimagining the mouse pointer for the AI era

#155

Post by iamcalledrob »

Nitpick, but it bothers me: The human factors of their demo video don't stack up.

Horizontal dragging with a mouse is actually really hard. Nobody's going to use it like that.

Your arm can easily move your hand and cursor up/down by pivoting your shoulder, but there's no mechanism for left/right movement. It's always an arc.

Or put another way: selection will be a lot slower and more tedious than the demo.

Re: Reimagining the mouse pointer for the AI era

#157

Post by ei23 »

why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

>Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you.

Reads like the argument against cell phones where don't have a cabinet around you...

Re: Reimagining the mouse pointer for the AI era

#160

Post by DonHopkins »

shimman wrote: post #134
websap wrote: post #130

Earlier quoted context omitted.

You should look into how often people are using tools like WisprFlow and SuperWhisper. Voice is a very native mechanism. Most people working in open floor plans are wearing headphones any way. As long as you're not screaming, it's probably fine. Maybe, we'll move away from open plan offices in the bid for efficiency, which I would welcome.

I'm sorry but if you think the amount of workers using voice controls in the office to be more than 1% you are in a massive bubble my dude.

Sorry to Bother You.

https://www.youtube.com/watch?v=XthLQZWIshQ

https://en.wikipedia.org/wiki/Sorry_to_Bother_You

Post reply on HN