Won't work on my Intel Macbook :-(
This is disappointing. Anything similar available for Intel Macs?
Show HN: I made an app to use local AI as daily driver
241–246 of 246 posts
Re: Show HN: I made an app to use local AI as daily driver
#242Earlier quoted context omitted.
Ctrl+F only gets you so far. It doesn't allow you to perform semantic searches, for example. If you don't happen to know a unique word (or set of words) to search for, you're out of luck. Just the other day, I was able to find a song by typing the phonetic pronunciation (well, as best I could) into ChatGPT, and it knew which song I was talking about right away. No way a regular search engine would've helped me there.
No. Your own data only gets you so far. And this is exactly the issue. No local model will make sense because the dataset its given is so small compared to what you are referring to - chatgpt. It's useless locally.
I have been downvoted here which is fine. But no one took the time to elaborate on where i am wrong ? Tell me where i am wrong please.
Re: Show HN: I made an app to use local AI as daily driver
#243Thank you for the work. Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though. ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what i…
Dangerously close to the old famous Dropbox comment to the original ShowHN post
Re: Show HN: I made an app to use local AI as daily driver
#244Earlier quoted context omitted.
Ctrl+F only gets you so far. It doesn't allow you to perform semantic searches, for example. If you don't happen to know a unique word (or set of words) to search for, you're out of luck. Just the other day, I was able to find a song by typing the phonetic pronunciation (well, as best I could) into ChatGPT, and it knew which song I was talking about right away. No way a regular search engine would've helped me there.
No. Your own data only gets you so far. And this is exactly the issue. No local model will make sense because the dataset its given is so small compared to what you are referring to - chatgpt. It's useless locally.
I’ve been using 7b models to work with large text volumes (like entire books) with nothing short of phenomenal results. It has cut the time I need to accomplish many tasks by >90% and often offers insights I might easily have missed. My methodology requires a bit of time and compute to prepare a new subject matter expert system, but the results are absolutely worth it.
Re: Show HN: I made an app to use local AI as daily driver
#245Earlier quoted context omitted.
No. Your own data only gets you so far. And this is exactly the issue. No local model will make sense because the dataset its given is so small compared to what you are referring to - chatgpt. It's useless locally.
I’ve been using 7b models to work with large text volumes (like entire books) with nothing short of phenomenal results. It has cut the time I need to accomplish many tasks by >90% and often offers insights I might easily have missed. My methodology requires a bit of time and compute to prepare a new subject matter expert system, but the results are absolutely worth it.
Would you care to share how you technically are doing this ? Please
Re: Show HN: I made an app to use local AI as daily driver
#246Earlier quoted context omitted.
1000 upvotes for you. My brain can't compute why someone hasn't made this, along with embeddings-based search that doesn't suck.
I bet UI and UX innovation will follow, but model quality is the most important thing. If I were OpenAI, I would 95% of resources on ChatGPT5, and 5% into UX. Once the dust settles, if humanity still exists, and human customers are still economically relevant, AI companies will shift more resources to UX.
I understand your point, but my take is that when we talk about AI and its impact, we're talking about the entire system: the model, and what is buildable with the model. To me, the gains available from doing innovative stuff w/ what we're colloquially calling "UI" exceeds, by a bunch, what the next model will unlock. But perhaps the main issue is that whatever this amazing UI might provide, it's not protectable in the way the model is. So maybe that's the answer.