How different is this compared to Jan.ai for example?
Show HN: I made an app to use local AI as daily driver
11–20 of 246 posts
Re: Show HN: I made an app to use local AI as daily driver
#12looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Anoth…
Maybe this isn't for everyone, just the people who place a high value on privacy.
Re: Show HN: I made an app to use local AI as daily driver
#13I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.
Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.
Re: Show HN: I made an app to use local AI as daily driver
#14Possibly a strange question, but do you have plans to add online models to the app? Local models just aren't at the same level, but I would certainly appreciate a consistent chat interface that lets me switch between GPT/Claude/local models.
You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions. [1]: https://github.com/iansinnott/prompta
This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.
Re: Show HN: I made an app to use local AI as daily driver
#15I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.
This. There was a post in HN last week, iirc, referring to just such a solution called ZenFetch (?). I would have adopted it in a heartbeat but they don’t currently have a means of exporting the source data you feed to it (should you elect it as your sole means of bookmarking, etc)
Re: Show HN: I made an app to use local AI as daily driver
#16How different is this compared to Jan.ai for example?
as i understand jan.ai is more focused on enterprise / platform, while I'd see where recursechat would go is more like "obsidian.md" but as your personal AI.
Re: Show HN: I made an app to use local AI as daily driver
#17looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Anoth…
Maybe this isn't for everyone, just the people who place a high value on privacy.
But how can I guarantee this app is private?
I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.
Re: Show HN: I made an app to use local AI as daily driver
#18Possibly a strange question, but do you have plans to add online models to the app? Local models just aren't at the same level, but I would certainly appreciate a consistent chat interface that lets me switch between GPT/Claude/local models.
https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%...
...how did you highlight a specific sentence like that?
Re: Show HN: I made an app to use local AI as daily driver
#19Looks great! Does it support different sized models, i.e. can I run llama 70B and 7B, and is there a way to specify which model to chat with? Are there plans to allow users to ingest their own models through this UI?
If you have a gguf file you can link it. For ingesting new models - I'm thinking about adding some CRUD UIs to it, but I'd like to keep a very small set of default models.
Re: Show HN: I made an app to use local AI as daily driver
#20Earlier quoted context omitted.
https://recurse.chat/faq/#:~:text=We%20support%20Mistral%2C%...
...how did you highlight a specific sentence like that?
Looks like a Chromium-specific feature: https://web.dev/articles/text-fragments
Pretty cool. Doesn't work on Firefox.