What I actually would be more willing to allow is a version of this that is built into macOS, runs locally, never phones home. If Apple Intelligence made an "AI sees everything on my screen", I might turn it on.
Reimagining the mouse pointer for the AI era
91–100 of 223 posts
Re: Reimagining the mouse pointer for the AI era
#92you can really tell the people building these tools spend a lot of time alone. I work from a home office 90% of the time and I wouldn't want this to be my workflow. I don't want to talk to my computer, I want to listen to music while I work, and I want to not sound deranged and disturb everyone around me when I am working from a coffeeshop or the open-plan office or the airport or the train or whatever. and that's as…
Agreed. A lot of Google products feel anti-social (like Google glass). They are definitely missing a human touch. Perhaps a byproduct of elitism and leet code grind filtering of employees mixed with founder personality.
Nothing else expected - one of the examples in this very article marks some text in a doc and prompts "make this more human"
Re: Reimagining the mouse pointer for the AI era
#93I think this falls flat for a technical audience because we already know how to do this stuff. But there are a lot of people who don't know how to copy paste, or use reverse image search, or apply a filter to a table. Being able to use plain language to do these things is a game changer for them. Sure, it's inefficient and inelegant but it's an interface that will do for basic technical stuff what the ipad touch screen did for the mouse and keyboard.
Re: Reimagining the mouse pointer for the AI era
#94I think this falls flat for a technical audience because we already know how to do this stuff. But there are a lot of people who don't know how to copy paste, or use reverse image search, or apply a filter to a table. Being able to use plain language to do these things is a game changer for them. Sure, it's inefficient and inelegant but it's an interface that will do for basic technical stuff what the ipad touch scre…
one step back, both for technical and non technical, is the knowledge that thats even a problem that you have.
the agent occasionally spots your real problem like an experienced engineer
Re: Reimagining the mouse pointer for the AI era
#95I've been doing something similar to this in a personal claude code frontend, though not particularly "magical". I'm mostly using my system to make comments on long AI-generated documents (especially design documents). I find it works well to have the AI generate something, and then I read through it, making comments along the way. You can get pretty far just repeating the things you see... "I'm reading [heading] and…
this is pretty built in with vscode plugins.
you select text in vscode, and write a comment, and the llm gets both
Re: Reimagining the mouse pointer for the AI era
#96I don't see how the examples given are much better than just natural language. With support for chaining multiple thought+capture then this could be pretty expressive and a nice accessible tool. I could see how eye gaze could be incorporated as well.
Re: Reimagining the mouse pointer for the AI era
#97I've been iterating on some 3D models for various wacky garage projects I have. It's fun. I've often wished I could click on an arbitrary place and say "add an eye bolt here" or somesuch. Of course learning proper cad software is probably the right thing here, but having Claude write python scripts which generate HTML files which reference three.js to provide a 3d view has gotten me surprisingly far. If something cou…
Hah, Ive been thinking the same thing. Recently I prototyped a 2d paint app to validate the idea using chrome's Prompt API: https://arjo129.github.io/apps/voice_paint.html Honestly what'd be epic is if this could be made to work with a XR headset. Imagine using the headset to capture the piece you are working on and generating saying "hey can you drill some holes over here"?
That would be pretty excellent. We need a layer agnostic notion of "here".
Until then I've just had it list every surface in a legend, each colored differently, so I can say "three inches down from the top of pole six, and rotate it so the hoop part of the bolt faces northwest."
Re: Reimagining the mouse pointer for the AI era
#98I’m having flashbacks to Windows 7 gadgets. I can already imagine some developer marketplace for creating cursor prompts.
Re: Reimagining the mouse pointer for the AI era
#99Re: Reimagining the mouse pointer for the AI era
#100[deleted]