Live data from Hacker News

Show HN: I made an app to use local AI as daily driver

recurse.chat

21–30 of 246 posts

Re: Show HN: I made an app to use local AI as daily driver

#22
post #3

looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Anoth…

Maybe this isn't for everyone, just the people who place a high value on privacy.

I mean, ok, then how do you distinguish yourself from LM Studio (Free)

Re: Show HN: I made an app to use local AI as daily driver

#23
post #16
post #11

How different is this compared to Jan.ai for example?

as i understand jan.ai is more focused on enterprise / platform, while I'd see where recursechat would go is more like "obsidian.md" but as your personal AI.

Obsidian has add-ons which do much of this.

Re: Show HN: I made an app to use local AI as daily driver

#24
post #13
post #8

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.

Yeah, we’re getting closer to “Her”

Re: Show HN: I made an app to use local AI as daily driver

#25

Earlier quoted context omitted.

You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions. [1]: https://github.com/iansinnott/prompta

This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.

Can you speak more to this? I get useful output from LLMs all the time, but never use system prompts. What am I missing?

Re: Show HN: I made an app to use local AI as daily driver

#26
post #23
post #16

Earlier quoted context omitted.

as i understand jan.ai is more focused on enterprise / platform, while I'd see where recursechat would go is more like "obsidian.md" but as your personal AI.

Obsidian has add-ons which do much of this.

People are treating Obsidian like it's the next Emacs

Re: Show HN: I made an app to use local AI as daily driver

#27

Earlier quoted context omitted.

You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions. [1]: https://github.com/iansinnott/prompta

This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.

You can update the system prompt in the settings. Admittedly this is not mentioned in the README, but is customizable.

Re: Show HN: I made an app to use local AI as daily driver

#29
post #8

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

plus one, I would love to configure a folder of markdown/txt(+ eventually images and pdfs) files that this can have access to. Ideally it could RAG over them in a sensible way. Would love to help support this!

Re: Show HN: I made an app to use local AI as daily driver

#30
What are the MacOS and hardware requirements? How does it perform on a slightly older model, lower powered Mac? I wish I could test this to see how it would perform, and while it's only $10, I don't want to spend that just to realize it won't work on my older, underpowered Mac mini.
Post reply on HN