Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Neverclick: Desktop application for performing mouse actions with your keyboard

github.com

Post reply on HN
Print view View original

21–30 of 67 posts

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#21

Post by kreelman »

Fire-Dragon-DoL wrote: post #15
AyanamiKaine wrote: post #11

Slightly related. On wayland based linux desktops this would never work because an app is not allowed to hijack the mouse pointer to dispatch events. I believe only the compositor is allowed to do that. I know, because I wanted to automate a GUI task using PyAutoGUI and it wouldnt work on wayland no matter what.

There is mouseless that seems to work on wayland https://mouseless.click/

That is an option, but it's not free.

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#22

Post by binarin »

AyanamiKaine wrote: post #11

Slightly related. On wayland based linux desktops this would never work because an app is not allowed to hijack the mouse pointer to dispatch events. I believe only the compositor is allowed to do that. I know, because I wanted to automate a GUI task using PyAutoGUI and it wouldnt work on wayland no matter what.

Actual problem on Wayland is that it often doesn't work when you are trying to click somewhere in the menu - for the mouse clicking app to read keyboard input, it must take focus away from the app where the click should go. And some toolkits just close menus on focus loss.

I personally use wl-kbptr, and the problem above is the only one that can't be solved without explicit support from the compositor.

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#23

Post by lazov »

krembo wrote: post #14

Nice work, but how is this different from Shortcat?

Most software in this space relies on accessibility apis, which means it only works in apps that have accessibility support. Neverclick uses computer vision. There are several advantages to using computer vision, the biggest one is that it works in every app. It also produces really good bounding boxes around text so it's great for editing text. And counterintuitively, it runs significantly faster than the traditional accessibility api approach. The hints show up instantaneously, even on old hardware.

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#24

Post by okeefe77 »

I understand the app is only installable on Windows, but what is the thinking behind not allowing downloads on non-Windows devices? I was going to save a copy of the installer to my Google Drive from my phone and the download button doesn't work. Seems like an odd choice that could hinder adoption.

(This is partially an assumption on my part as I currently don't have an unrestricted Windows machine to verify, but considering the non-functional button and "download on Windows" message it displays it seemed safe to assume)

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#26

Post by gen2brain »

granra wrote: post #5

This looks cool! How is the planned Linux support (the website says "Coming soon for Linux") suppose to work? X11 only? Wayland? Gnome only (or any other DE)?

I am guessing wp_pointer_warp_v1 in Wayland, but not sure if all compositors support that. And that is just for moving the cursor. Can we "send" a wl_pointer click like that?

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#27

Post by gen2brain »

AyanamiKaine wrote: post #11

Slightly related. On wayland based linux desktops this would never work because an app is not allowed to hijack the mouse pointer to dispatch events. I believe only the compositor is allowed to do that. I know, because I wanted to automate a GUI task using PyAutoGUI and it wouldnt work on wayland no matter what.

What about wp_pointer_warp_v1? That should be supported in some compositors. But not sure how to actually "send" the click event.

I often try a session with Labwc/LxQt instead of my Openbox/LxQt, and while there is progress, still not fully usable, so still no Wayland for me. But with X11, I can at least add xvfb, xdotool, and other utils, and AI has no problem writing (and testing) a GUI for me.

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#28

Post by jcelerier »

AlienRobot wrote: post #12
AyanamiKaine wrote: post #11

Slightly related. On wayland based linux desktops this would never work because an app is not allowed to hijack the mouse pointer to dispatch events. I believe only the compositor is allowed to do that. I know, because I wanted to automate a GUI task using PyAutoGUI and it wouldnt work on wayland no matter what.

I wonder if blender works on wayland, because it has a feature that makes the mouse cursor "loop" across the window if you are dragging something.

The protocol for this has recently been accepted, now it has to be implemented by every compositor

Re: Neverclick: Desktop application for performing mouse actions with your keyboard

#30

Post by AyanamiKaine »

Fire-Dragon-DoL wrote: post #15
AyanamiKaine wrote: post #11

Slightly related. On wayland based linux desktops this would never work because an app is not allowed to hijack the mouse pointer to dispatch events. I believe only the compositor is allowed to do that. I know, because I wanted to automate a GUI task using PyAutoGUI and it wouldnt work on wayland no matter what.

There is mouseless that seems to work on wayland https://mouseless.click/

But only if you "disable Wayland’s extra restrictions around keyboard/mouse access for Mouseless to work". [0]

[0] https://mouseless.click/docs/wayland_configuration.html

Post reply on HN