Live data from Hacker News

System: Control your Mac from anywhere using natural language

system.surf

21–30 of 35 posts

Re: System: Control your Mac from anywhere using natural language

#21
The tools.ts is the best file to read to understand what this thing can do - it's mainly shell and AppleScript stuff: https://github.com/ygwyg/system/blob/main/src/bridge/tools.t...

I don't trust this list of "safe commands": https://github.com/ygwyg/system/blob/b5adfe526da7470cade61f7...

It includes python3 and node under the heading "Dev tools (read-only)" - but I don't think "read-only" is enforced anywhere.

Re: System: Control your Mac from anywhere using natural language

#23
- this requires you to keep your mac turned on when you are 1000 kms away from home

- i am still waiting for an agent that turns your mac automatically on when you are away and then lets you control the machine.

- perhaps a robot arm operated by cloudflare agents with opencv camera to detect where your switch is present and where the plug is present remote controlled would do the job?

- it can also unplug the device when you are done using it

Re: System: Control your Mac from anywhere using natural language

#24

love how clearly vibecoded this is. the cloudflare worker architecture + the ascii diagram is a dead giveaway. nothing wrong with that, it's just really obvious. the split architecture offers absolutely zero security benefits outside of not exposing a server process on your mac to the open internet (assuming you only let it connect to cloudflare) - it's just a convenient place to spin up a thin JS layer that calls mo…

How is it a giveaway? I'd like to learn how to spot these things.

Re: System: Control your Mac from anywhere using natural language

#25
post #22
post #3

Anything where an LLM has access to the shell on my personal laptop isn’t “secure” even if you do some hand waving around a split architecture.

Give it a separate user or a VM.

Don't forget to manage proper permissions for every piece of data your own user account would need acccess to complete the objectives of the agent.

Like in the "Play some jazz music" example in the documentation, don't forget to login to the Music app using your own Apple ID on the new user or VM you created.

Re: System: Control your Mac from anywhere using natural language

#26

Seems like it needs higher level stuff, although that's a bit too sci-fi. Captain Picard can just ask "Computer, where is Commander Riker?" and the computer answers him, he doesn't need to say "Computer, launch people finder app" and "Computer, input 'Commander Riker' in the people finder app"... I use Google Assistant for things like "add a reminder", "set an alarm", which is natural language processing but doesn't…

Funny you should mention that, I literally today asked Siri on my HomePod: “Siri where’s my wife?” It worked (once).

Re: System: Control your Mac from anywhere using natural language

#27
post #22
post #3

Anything where an LLM has access to the shell on my personal laptop isn’t “secure” even if you do some hand waving around a split architecture.

Give it a separate user or a VM.

specifically, tart lets you run macOS on macOS fairly well.

Re: System: Control your Mac from anywhere using natural language

#28
post #8
post #3

Anything where an LLM has access to the shell on my personal laptop isn’t “secure” even if you do some hand waving around a split architecture.

Nothing more like playing Russian roulette with your own machine, hoping that when it needs to delete, move or rename a file, you sure hope it doesn't begin running either (especially do not run with --dangerously-skip-permissions): rm -rf ~/ rm -rf / mv ~/ ./ Or even creating a faulty symbolic link and above your home directory and suggesting to remove it, then it actually removes everything in that folder including…

Of course, only an idiot would do that, and have it go and delete a bunch of shit. I, unfortunately, am that idiot, so if you're also going to be such an idiot, I recommend putting rm behind any sort of wall, no matter how short it should be, eg https://gist.github.com/fragmede/96f35225c29cf8790f10b1668b8...

Re: System: Control your Mac from anywhere using natural language

#29

love how clearly vibecoded this is. the cloudflare worker architecture + the ascii diagram is a dead giveaway. nothing wrong with that, it's just really obvious. the split architecture offers absolutely zero security benefits outside of not exposing a server process on your mac to the open internet (assuming you only let it connect to cloudflare) - it's just a convenient place to spin up a thin JS layer that calls mo…

Why does it matter? If it works, it works, no? Or are we now artisanal hipsters, where the code is better if it was hand-typed on a really shitty keyboard where the N key sticks, and it just feels better using the software because of how much pain the coder in the forests outside of Portland experienced while writing the code. Do we need an international fair trade organization to make sure the code was ethically sourced?

Re: System: Control your Mac from anywhere using natural language

#30
post #26

Seems like it needs higher level stuff, although that's a bit too sci-fi. Captain Picard can just ask "Computer, where is Commander Riker?" and the computer answers him, he doesn't need to say "Computer, launch people finder app" and "Computer, input 'Commander Riker' in the people finder app"... I use Google Assistant for things like "add a reminder", "set an alarm", which is natural language processing but doesn't…

Funny you should mention that, I literally today asked Siri on my HomePod: “Siri where’s my wife?” It worked (once).

I have an alarm clock with Google Assistant, I can ask it where my Pixel 7 is, and it will make that phone ring using whatever Google's equivalent of Find My Phone is.
Post reply on HN