Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Agent-desktop – Native desktop automation CLI for AI agents

github.com

Post reply on HN
Print view View original

31–40 of 55 posts

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#31

Post by zero_shift »

nerdsniper wrote: post #12
jstanley wrote: post #4

lahfir, I vouched your (currently still dead) comment because it was interesting to me. I expect the reason it is dead is that it seems LLM-generated (you "quietly" launched it on github? Who says that?). Also, your comment claims that the tool is cross-platform and implies that it works on Mac, Windows, and Linux, but the graphic on the github README says it only works on Mac.

It looks hybrid human/LLM at best, but definitely possible that it's mostly human, from someone who is earnestly learning how to use "pitch" language. I got the feeling that some parts, like the bullet points, maybe originated from AI-generated documentation/readme's. My intuition tells me that it could have been AI-generated, but if that's the case then it was heavily edited by a human. I think anyone who went throu…

I think this guy is using AI for pretty much everything - he says as much in his GH profile. In fact his photo bears a Gemini watermark, meaning that is AI too.

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#34

Post by lukewarm707 »

xnx wrote: post #22

The best desktop automation system would take HDMI input and output USB keystrokes and mouse movements so that it can be plugged into any computer transparently, including work computers.

if you can attach a local llm...hdmi is airgapped (sort of)...

the operating computer requires no processing power or install....

it plugs into any interface............

i plug it into a scada...............

$$$$$$

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#35

Post by dmd »

lukewarm707 wrote: post #34
xnx wrote: post #22

The best desktop automation system would take HDMI input and output USB keystrokes and mouse movements so that it can be plugged into any computer transparently, including work computers.

if you can attach a local llm...hdmi is airgapped (sort of)... the operating computer requires no processing power or install.... it plugs into any interface............ i plug it into a scada............... $$$$$$

What’s the purpose of all the dots?

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#36

Post by jstanley »

preommr wrote: post #15
jstanley wrote: post #4

lahfir, I vouched your (currently still dead) comment because it was interesting to me. I expect the reason it is dead is that it seems LLM-generated (you "quietly" launched it on github? Who says that?). Also, your comment claims that the tool is cross-platform and implies that it works on Mac, Windows, and Linux, but the graphic on the github README says it only works on Mac.

Wouldn't the opposite be true? That an llm would use well-known terms for general purpose writing. I think it's much more likely that a human would remember 'silent' launch, or 'stealth' launch, and use silent as a substitute. I feel very strongly that comment wasn't AI generated. Also, there's a bunch of normal comments that seem to be wrongfully flagged.

> Wouldn't the opposite be true? That an llm would use well-known terms for general purpose writing.

You'd think, and yet LLMs do in fact have a particular style, and lots of it is common across all LLMs.

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#37

Post by DeathArrow »

I presume this only works if you use native OS interfaces like MFC in Windows, Cocoa in macOS or GTK in Linux.

It would be nice if it could work if you use GUI libraries that talk directly to hardware like Capy for Zig, egui for Rust or Dear ImGui for C++.

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#38

Post by _crowecawcaw »

I actually built nearly the same tool under the same name: https://agent-desktop.dev And I've seen a couple other similar projects since then too! Seems like a lot of us are thinking in the same direction.

One wrinkle I found is that there wasn't a cross-platform library for accessibility APIs, and each platform is a bit different. I made an a11y library that supports Mac, Windows, and X11 and Wayland on Linux with consistent interface: https://xa11y.dev

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#39

Post by zuzululu »

handfuloflight wrote: post #19
zuzululu wrote: post #11

This is neat! Tried the finder example and was impressed how quick it was. I would love it if it can support ios simulator, iphone? I am using Maestro but it is so damn slow and seems to be token hungry.

https://github.com/callstackincubator/agent-device

seems like this is for React Native, flutter won't expose the trees, bummer.

Guess I'm stuck with Maestro

Re: Show HN: Agent-desktop – Native desktop automation CLI for AI agents

#40

Post by gvkhna »

esperent wrote: post #6

Looks interesting but like every single one of these computer use apps I've seen, it's macOS only. Does anyone know of a linux one?

Built this but not open source because it’s more designed for the bot evasion/stealth market. But it’s designed to let ai control the real browser without cdp. So no chromium forks/nothing to “detect.”
Post reply on HN