Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reimagining the mouse pointer for the AI era

deepmind.google

Post reply on HN
Print view View original

201–210 of 223 posts

Re: Reimagining the mouse pointer for the AI era

#201

Post by neuronexmachina »

why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

> So is this thing talking to Google's servers all the time for the AI integration? So it won't work if you're not connected to the internet?

I assume they're using on-device Gemini Nano: https://developer.android.com/ai/gemini-nano

Re: Reimagining the mouse pointer for the AI era

#203

Post by shimman »

DonHopkins wrote: post #160
shimman wrote: post #134

Earlier quoted context omitted.

I'm sorry but if you think the amount of workers using voice controls in the office to be more than 1% you are in a massive bubble my dude.

Sorry to Bother You. https://www.youtube.com/watch?v=XthLQZWIshQ https://en.wikipedia.org/wiki/Sorry_to_Bother_You

Don't know if you're making a joke, but call center workers using a phone is not the same thing as a call center worker doing all their work on a phone. Worked in a call center for 4 years, one thing everyone needed after their shift was to just STFU for a few hours to decompress.

Re: Reimagining the mouse pointer for the AI era

#205

Post by danielbusnz123 »

I started building an open-source Rust version of this idea for Linux/Hyprland last week, before the announcement. Different design (OS-level instead of browser-only, Anthropic Haiku 4.5 + Computer Use instead of Gemini, sub-3s release-to-speech). Code: github.com/danielbusnz-lgtm/aegis

Re: Reimagining the mouse pointer for the AI era

#206

Post by kjs3 »

jeswin wrote: post #151
jasonjayr wrote: post #149

Earlier quoted context omitted.

The killer app was conceived as early as the 1980s: an agent running on your computer, organizing your files, your schedule, your messages, your bills, bank accounts, etc. All the parts of your life that were routine drudgery should be able to be offloaded to a smart agent, based on your preference, to bring you the information you needed with natural language queries, contextualized to what you were doing at the tim…

A few decades back, a lot of computer use was emails. And it was stored on someone else's servers - with everyone from server operators along the route, to the government potentially having access to it. Even HTTPS is a relatively recent thing. I guess what I'm saying is - we've always had this problem.

As an email admin a few decades back, there's just a tiny bit of difference between "my corp or school has a mail server and holds my email and an admin could look at it" and "Google and a tiny number of other companies hold most everyones email and always looks at it".

Re: Reimagining the mouse pointer for the AI era

#208

Post by e12e »

why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

> Anything with voice controls for routine use is a pretty tough sell.

Depends on how many hands you've recently broken?

Re: Reimagining the mouse pointer for the AI era

#209

Post by xigoi »

etchalon wrote: post #62

I don't understand why we need to move from an explicit operation like, say, circling something, to a fuzzy one where you have to hope the machine understands what you're pointing at. I also don't think people want to constantly talk to their computers.

> I also don't think people want to constantly talk to their computers.

People don’t. Tech companies think they do.

Re: Reimagining the mouse pointer for the AI era

#210

Post by unsupp0rted »

why_at wrote: post #28

My first impression coming away from this is skepticism. Anything with voice controls for routine use is a pretty tough sell. Doing this when you're not completely alone would be annoying to everyone around you. Most of their examples seem like they could have been done with a right click drop down menu so they don't really need to "re-invent the mouse pointer". So is this thing talking to Google's servers all the ti…

> Doing this when you're not completely alone would be annoying to everyone around you

I'm surprised sub-vocal HCI isn't better developed by now. Perhaps because of this stuff coming out it will be.

Humans speaking to one another is literally telepathy: I'm putting my thoughts in your head, with lots of ambiguity and noise, of course.

With better sub-vocal tech we can control our devices without bothering each other.

https://www.media.mit.edu/articles/exclusive-startup-lets-yo...

Post reply on HN