Sidekick: Local-first native macOS LLM app
1–10 of 97 posts
Re: Sidekick: Local-first native macOS LLM app
#2[flagged]
Re: Sidekick: Local-first native macOS LLM app
#3An option to use a local LLM on network without needing to download the 2GB "default model" would be great
Re: Sidekick: Local-first native macOS LLM app
#4[flagged]
Just checked some Genmojis created on reddit, wow, i don't know how that got approved. I'm all for creativity and freedom but it's 100% not apples brand.
And they just postponed AI-Siri to 2026 after promising it for iPhone 16. I seriously don't get how it can be that hard. Small model trained on various app API's, a checker model that double checks, an approve this action button. Not that hard.
Re: Sidekick: Local-first native macOS LLM app
#5[flagged]
I don't think Apple has missed out on much (yet). The best LLM's (e.g. gpt4o, sonnet 3.7) are no where near being able to run locally and still make mistakes.
Some LLMs can run locally, but are brutally slow with small context windows.
Apple is likely waiting until you can run a really good model on device (i.e. iOS), which makes sense to me. It's not like they're losing customers over this right now.
Re: Sidekick: Local-first native macOS LLM app
#6> Image generation is availible on macOS 15.2 or above, and requires Apple Intelligence.
... so image generation is not fully offline?
This tool looks like it could be worth a try to me, but only if I'm sure I can run it into a mode that's fully offline.
Re: Sidekick: Local-first native macOS LLM app
#7> Image generation is availible on macOS 15.2 or above, and requires Apple Intelligence. ... so image generation is not fully offline? This tool looks like it could be worth a try to me, but only if I'm sure I can run it into a mode that's fully offline.
isn't apple intelligence image generation fully offline?
Re: Sidekick: Local-first native macOS LLM app
#8Some interesting features. I'm working on similar native app with Qt so it will support Linux, macOS and Windows out of the box. I might open source it as well.
Re: Sidekick: Local-first native macOS LLM app
#9[flagged]
I don't think Apple has missed out on much (yet). The best LLM's (e.g. gpt4o, sonnet 3.7) are no where near being able to run locally and still make mistakes. Some LLMs can run locally, but are brutally slow with small context windows. Apple is likely waiting until you can run a really good model on device (i.e. iOS), which makes sense to me. It's not like they're losing customers over this right now.
Siri hasn't run on device for most of its existence. It's only in the last few years that Apple suddenly decided it was a priority.
Re: Sidekick: Local-first native macOS LLM app
#10Why no MLX?