Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity.
Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.
Show HN: I made an app to use local AI as daily driver
41–50 of 246 posts
Re: Show HN: I made an app to use local AI as daily driver
#42Earlier quoted context omitted.
This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.
Can you speak more to this? I get useful output from LLMs all the time, but never use system prompts. What am I missing?
Sure, I use one system prompt template to make ChatGPT be more concise. Compare these two: https://sharegpt.com/c/fEZKMIy vs https://sharegpt.com/c/S2lyYON
I use similar ones to get ChatGPT to be more thorough or diligent as well. From my limited experience with local models, this type of system prompting is even more important than with ChatGPT 4.
Re: Show HN: I made an app to use local AI as daily driver
#43Wow, I did not expect at all this will end up on the front page. Thank you for all the enthusiasm, I'll try to get to more questions later today but if there's something I missed my X/twitter DM is open: https://x.com/chxy
Re: Show HN: I made an app to use local AI as daily driver
#44Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity. Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.
Thank you so much for the support! Simplicity is power indeed. I'm on twitter: https://x.com/chxy
Re: Show HN: I made an app to use local AI as daily driver
#45Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity. Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.
Found your Twitter account in a previous post. Just tagged you.
Re: Show HN: I made an app to use local AI as daily driver
#46I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.
This. There was a post in HN last week, iirc, referring to just such a solution called ZenFetch (?). I would have adopted it in a heartbeat but they don’t currently have a means of exporting the source data you feed to it (should you elect it as your sole means of bookmarking, etc)
Hey there,
This is Gabe, the founder of Zenfetch. Thanks for sharing. We're putting together an export option where you can download all your saved data as a CSV and should get that out by end of week.
Re: Show HN: I made an app to use local AI as daily driver
#47looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Anoth…
The compelling reason to shift to local/decentralized AI is that all of compute will soon be AI and that means your entire existence will go into it. The question you should ask yourself is do you want everything about you being handled by Sam Altman, Google, Microsoft, etc? Do you want all of your compute dependent on them always being up and do you want to trust their security team with your life? Do you want to still be using closed/centralized/hosted AI when truly open AI surpasses all of them in performance and capability. If you have children or family, do you want them putting their entire lives in the hands of those folks.
Decentralized AI will eventually become p2p and swarmed and then the true power of agents and collaboration will soar via AI.
Anyway, excuse the soap box, but there are zero valid reasons for supporting and paying centralized keepers of AI that rarely share, collaborate or give back to the community that made what they have possible.
Re: Show HN: I made an app to use local AI as daily driver
#48Earlier quoted context omitted.
This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.
You can update the system prompt in the settings. Admittedly this is not mentioned in the README, but is customizable.
> the system prompt
There isn't a singular system prompt. It really does matter!
Copy the OpenAI playground, you'll thank yourself later
Re: Show HN: I made an app to use local AI as daily driver
#49This is awesome. I currently use Ollama with OpenWebUI but am a big fan of native apps so this is right up my alley.
Re: Show HN: I made an app to use local AI as daily driver
#50Hey! This is awesome! How hard would it be to plug it into something like Raindrop.io (bookmark manager) to train on all bookmarks collected?