Earlier quoted context omitted.
I did have a recording function around, to track mouse movement. The issue is that the mouse movement gets verbose, and you would have to clean that up somehow.
Sounds like a candidate for machine learning - and an excuse to learn it.
Self Driving Desktop
11–20 of 39 posts
Re: Self Driving Desktop
#12Perhaps 2-3 paragraphs describing what it does?
Re: Self Driving Desktop
#13Worked well last I tried it.
Re: Self Driving Desktop
#14Re: Self Driving Desktop
#15Re: Self Driving Desktop
#16One of the most unknown tools (>10 years) http://sikulix.com/ It allows play mouse/keyboard event scrips BUT it allows to find components (coords) via screen OCR so you can make your scripts multi resolution/desktop independent. Also, it's Java based so you can play it multi SO.
Re: Self Driving Desktop
#17The problem with tools like this is that they create an API that the developers don't know about and have no intention of supporting. I broke one recently by having the app maximize on startup, but everything from adding UI elements, rearranging them or timing differences can introduce breakages.
Considering it's scripting anyway, an actual API would be easier.
Re: Self Driving Desktop
#18One of the most unknown tools (>10 years) http://sikulix.com/ It allows play mouse/keyboard event scrips BUT it allows to find components (coords) via screen OCR so you can make your scripts multi resolution/desktop independent. Also, it's Java based so you can play it multi SO.
This is an excellent tool! But you forgot to mention that the user codes it in python, it comes with a purpose built ide, it recognises both text and images the latter with an approximation capability.
https://en.m.wikipedia.org/wiki/Comparison_of_GUI_testing_to...
My favorite on the Windows side was vTask Studio, but it looks like the domain is down and the link was removed from that wiki page.
Re: Self Driving Desktop
#19Earlier quoted context omitted.
I use OBS for recording and Flowblade for editing. Got sick of editing my mistakes out, so then this repo came to be. Planning to add some playlists to start that up, set file names, begin/end recording. self-driving-desktop will be part of a demo automation framework that is in the progress.
I did have a recording function around, to track mouse movement. The issue is that the mouse movement gets verbose, and you would have to clean that up somehow.
Re: Self Driving Desktop
#20One of the most unknown tools (>10 years) http://sikulix.com/ It allows play mouse/keyboard event scrips BUT it allows to find components (coords) via screen OCR so you can make your scripts multi resolution/desktop independent. Also, it's Java based so you can play it multi SO.