Live data from Hacker News

Sidekick: Local-first native macOS LLM app

github.com

31–40 of 97 posts

Re: Sidekick: Local-first native macOS LLM app

#31
Looks nice, and I greatly appreciate the local only or local first mode.

The readme says:

> Give the LLM access to your folders, files and websites with just 1 click, allowing them to reply with context.

> Context aware. Aware of your files, folders and content on the web.

Am I right in assuming that this works only with local text files and that it cannot integrate with data sources in Apple’s apps such as Notes, Reminders, etc.? It could be a great competitor to Apple Intelligence if it could integrate with apps that primarily store textual information (but unfortunately in their own proprietary data formats on disk and with sandboxing adding another barrier).

Can it use and search PDFs, RTF files and other formats as “experts”?

Re: Sidekick: Local-first native macOS LLM app

#32
I've been looking for something like this to query / interface with the mountain of home appliance manuals I've hung onto as PDFs - use case being that instead of having to fish out and read a manual once something breaks, I can just chat with the corpus to quickly find what I need to fix something. Will give it a shot!

Re: Sidekick: Local-first native macOS LLM app

#36
post #29

Does anyone know if there is something like this or https://github.com/kevinhermawan/Ollamac for linux ... both are build with swift and swift also supports linux!?

Desktop-wise there's https://msty.app which is rather good but not open source. I'm using OpenWeb UI [1] with a desktop shortcut but that's a web app. 1 - https://github.com/open-webui/open-webui

https://jan.ai is open source and works on linux.

Re: Sidekick: Local-first native macOS LLM app

#37
post #31

Looks nice, and I greatly appreciate the local only or local first mode. The readme says: > Give the LLM access to your folders, files and websites with just 1 click, allowing them to reply with context. … > Context aware. Aware of your files, folders and content on the web. Am I right in assuming that this works only with local text files and that it cannot integrate with data sources in Apple’s apps such as Notes,…

> Am I right in assuming that this works only with local text files

One of the screen shots shows a .xlsx in the “Temporary Resources” area.

Also: I haven’t checked, but for a “Local-first” app, I would expect it to leverage Spotlight text importers from the OS, and run something like

  mdimport -t -d3 *file*
on files it can’t natively process.

Re: Sidekick: Local-first native macOS LLM app

#39
Looks super neat!

Somewhat related, one issue i have with projects like these is it appears like everyone is bundling the UX/App with the core ... pardon my ignorance, "LLM App interface". Eg We have a lot of abstractions for LLMs themselves such as Llama.cpp, but it feels like we lack abstractions for things like what Claude Code does, or perhaps this RAG impl, or whatever.

Ie these days it seems like a lot of the magic in a quality implementation is built on top of a good LLM. A secondary layer which is just as important as the LLM itself. The prompt engineering, etc.

Are there any attempts to generalize this? Is it even possible? Feels like i keep seeing a lot of good ideas which get locked behind an app wall and no ability to switch them out. We've got tons of options to abstract the LLMs themselves, but i've not seen anything which tackles this (but i've also not been looking).

Does it exist? Does this area have a name?

Re: Sidekick: Local-first native macOS LLM app

#40

What an great looking tool. Amazingly generous that it’s open source. Let’s hope the author can keep building it, but if they need to fund their existence there is precedent - lots of folks pay for Superwhisper. People pay for quality software. In a past tech cycle Apple might’ve hired the author, acquired the IP and lovingly stewarded the work into a bundled OS app. Not something to hope for lately. So just going to…

Yep, I think the guy who’ll make the GUI for LLMs is the next Jobs/Gates/Musk and Nobel Prize Winner (I think it’ll solve alignment by having millions of eyes on the internals of LLMs), because computers became popular only after the OS with a GUI appeared. I just started ASK HN to let people and me share their AI safety ideas, both crazy and not: https://news.ycombinator.com/item?id=43332593
Post reply on HN