Sidekick: Local-first native macOS LLM app • Hacker News Board

Re: Sidekick: Local-first native macOS LLM app

#21

Post by MichaelTheGeek » Tue, Mar 11, 2025, 12:34 PM UTC

Very nice.

Re: Sidekick: Local-first native macOS LLM app

#22

Post by aa-jv » Tue, Mar 11, 2025, 12:35 PM UTC

Gracana wrote: post #19

aa-jv wrote: post #15

Trying to put this through its paces, I first set out to build my own local binary (because why not, and also because code-reading is fun when you've got your own local build) .. But I get this far: /Users/aa-jv/Development/InterestingProjects/Sidekick/Sidekick/Logic/View Controllers/Tools/Slide Studio/Resources/bin/marp: No such file or directory It seems there is a hand-built binary resource missing from the repo -…

Looks like it wants https://github.com/marp-team/marp-cli

Yeah, I've manually copied that binary into place from the marp-cli package in homebrew and now the build proceeds .. continuing as I type .. lets see what happens.

I'm immediately suspicious of such binary resources, however.

Re: Sidekick: Local-first native macOS LLM app

#23

Post by john_alan » Tue, Mar 11, 2025, 12:36 PM UTC

Pretty slick, I've been using Ollama + https://github.com/kevinhermawan/Ollamac - not sure this provides much extra benefit. Still love to see it.

Re: Sidekick: Local-first native macOS LLM app

#24

Post by 0xferruccio » Tue, Mar 11, 2025, 12:47 PM UTC

Really cool! I hope they'll roll out MCP support so that we can add support for it in our MCP app store (https://github.com/fleuristes/fleur)

Right now only code editors and Claude support MCPs, but we'd love to see more clients like Sidekick

Re: Sidekick: Local-first native macOS LLM app

#25

Post by nebulous1 » Tue, Mar 11, 2025, 12:49 PM UTC

The name gave me a flashback to Borland Sidekick

Re: Sidekick: Local-first native macOS LLM app

#26

Post by delijati » Tue, Mar 11, 2025, 12:55 PM UTC

Does anyone know if there is something like this or https://github.com/kevinhermawan/Ollamac for linux ... both are build with swift and swift also supports linux!?

Re: Sidekick: Local-first native macOS LLM app

#27

Post by nottorp » Tue, Mar 11, 2025, 12:56 PM UTC

greggsy wrote: post #16

nottorp wrote: post #6

> Image generation is availible on macOS 15.2 or above, and requires Apple Intelligence. ... so image generation is not fully offline? This tool looks like it could be worth a try to me, but only if I'm sure I can run it into a mode that's fully offline.

Some features use private cloud, but it's pretty decent in terms of security and privacy. https://security.apple.com/blog/private-cloud-compute/

"Pretty decent" is irellevant for proprietary code that's not my property.

The only safe option is if it's guaranteed to not leave my machine, so for this app, to disable anything that has a chance of exfiltrating data.

Re: Sidekick: Local-first native macOS LLM app

#28

Post by [deleted] » Tue, Mar 11, 2025, 1:07 PM UTC

aneutron wrote: post #2

[flagged]

[deleted]

Re: Sidekick: Local-first native macOS LLM app

#29

Post by Matl » Tue, Mar 11, 2025, 1:25 PM UTC

delijati wrote: post #26

Does anyone know if there is something like this or https://github.com/kevinhermawan/Ollamac for linux ... both are build with swift and swift also supports linux!?

Desktop-wise there's https://msty.app which is rather good but not open source. I'm using OpenWeb UI [1] with a desktop shortcut but that's a web app.

1 - https://github.com/open-webui/open-webui

Re: Sidekick: Local-first native macOS LLM app

#30

Post by yohannparis » Tue, Mar 11, 2025, 1:47 PM UTC

AutoAPI wrote: post #3

An option to use a local LLM on network without needing to download the 2GB "default model" would be great

It's in the README https://github.com/johnbean393/Sidekick?tab=readme-ov-file#f...