Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reimagining the mouse pointer for the AI era

deepmind.google

Post reply on HN
Print view View original

181–190 of 223 posts

Re: Reimagining the mouse pointer for the AI era

#181

Post by xigoi »

kjellsbells wrote: post #22

I sense a privacy problem brewing. It reminds me of Microsoft Recall in the sense that some portion of the screen is going to be continuously transmitted outside of the users control. What happens when someone browses something very private (planning a surprise engagement. looking at medical data. planning a protest)? All that data gets slurped to google and subject to a warrant or discovery or building your advertis…

That’s the whole point. Users who want this “feature” will give Google permission to permanently record their screen.

Re: Reimagining the mouse pointer for the AI era

#183

Post by jiehong »

el_benhameen wrote: post #146
Melatonic wrote: post #142

Earlier quoted context omitted.

I feel like I can type faster than I can talk but I could be totally wrong?

I also feel this way, but more importantly, I feel like my sentences are more coherent when typed because typing allows for corrections and modifications of ideas. Do whispr people just … get coherent, finalized ideas out in a single shot without any misspoken words?

transcription gets post-processed by a LLM (with different styles, like based on prompts, so that it removes fillers, homophones, change the style, etc.

I recommend the youtube channel @afadingthought to see what people come up with (like v=283-z29TXeM).

Re: Reimagining the mouse pointer for the AI era

#184

Post by jiehong »

Now, with vim/helix key bindings:

1. select text

2. dictate action

Feels very similar to Helix's select text and act on it.

I think text selection could also be voice controlled (with a modal voice input), so one could say: "select sentence, action mode, copy and paste it in my list and remove duplicates"

Re: Reimagining the mouse pointer for the AI era

#185

Post by wffurr »

"Wiggle" the mouse cursor to do something - isn't this incredibly easy to trigger by accident? I remember turning on a "find cursor" mode in Windows once upon a time where it would zoom the mouse cursor on a wiggle, and it fired all the time by accident. Imagine an older person or child who is even less accurate with the mouse, too.

Re: Reimagining the mouse pointer for the AI era

#186

Post by wffurr »

joe5150 wrote: post #44
chromacity wrote: post #42

My reaction to the first demo (recipe) is that it was slower than typing the same thing on your keyboard. The second demo seems to be a wash: there's no time saved in saying "move this" versus "move crab". And an app-specific contextual menu would probably be faster. The third demo doesn't seem to warrant the use of a pointer at all, since there is only one way to interpret the prompt. None of this means that this ap…

Talking to your computer can only ever work for people in atomized work-from-home silos, surely. I can't really imagine living in a world where everybody is just muttering commands to the computer all the time.

Working near the Android Assistant team is like this. It's pretty chaotic.

Re: Reimagining the mouse pointer for the AI era

#187

Post by YeGoblynQueenne »

why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

Yes, it does seem kinda ... pointless.

Re: Reimagining the mouse pointer for the AI era

#188

Post by cmrdporcupine »

rhet0rica wrote: post #147
tintor wrote: post #12

Of course, it isn't a Google Demo, if you can't use it to book a table at restaurant. (shown at the bottom of the page)

My thoughts exactly. Why the fuck is this the primary concern of EVERY person who works at Google?!

What else can you do in the Bay Area sprawl other than work and go to restaurants? Is there anything else?

Re: Reimagining the mouse pointer for the AI era

#189

Post by xigoi »

IG_Semmelweiss wrote: post #132

50yr old tech (mouse) still hangs around because it is effective. Whatever this Google slop is, will likely not replace mice. The mouse has been successful at passing the test of time. Most of Google's own hardware products don't last 1/20th of that time. There's a reason chairs are still around. They are +2000 years old. Its still waiting to be replaced. One should be extremely skeptical of claims of replacing tech…

You’re just giving them ideas for AI chairs.

Re: Reimagining the mouse pointer for the AI era

#190

Post by pshirshov »

Could we play bullshit bingo?

Bullshit!

You don't need any new metaphors to support such (questionable) flows - at all.

Swipes instead of selection rectangles are annoying - you don't see the traces of the swipes on these demo gifs! So, you've effectively "selected" something - but you have to keep in mind WHAT you selected.

Total ridiculous bullshit.

Post reply on HN