Any censorship?
(Can't try MacOS Apps)
Show HN: I made an app to use local AI as daily driver
131–140 of 246 posts
Re: Show HN: I made an app to use local AI as daily driver
#132Out of curiosity – how is this app built?:-) There is a demo clip with a vertical scroll bar which does not fade out as it would do in a native mac app:)
Scroll bars don't fade out if you're using a mouse (as opposed to just a trackpad) or if you've set Mac OS Settings > Appearance > Show scroll bars to "Always".
Re: Show HN: I made an app to use local AI as daily driver
#133Earlier quoted context omitted.
I am the author of Msty app mentioned here. So humbled to see an app that is just about a month old that I mostly wrote for my wife and some friends to begin with (who got overwhelmed with everything that was going in LLM world), on the top of your list. Thank you!
If you need help for testing the Linux version let me know, I’d be happy to help
I was actually looking for one! What's the best way to reach you? Mind jumping on our Discord so that I can share the installer with you soon?
Re: Show HN: I made an app to use local AI as daily driver
#134Earlier quoted context omitted.
I am the author of Msty app mentioned here. So humbled to see an app that is just about a month old that I mostly wrote for my wife and some friends to begin with (who got overwhelmed with everything that was going in LLM world), on the top of your list. Thank you!
One bit of feedback: there's nowhere to put system messages. These can be much more influential than user prompts when it comes to shaping the tone and style of the response.
That's on the top of our list. It got pushed back because we want to support creating a character/profile (basically select a model and apply some defaults including a system prompt). But I feel like that was a mistake tomwait for it. Regardless, it is getting added in the next release (the one after something that is dropping in a day or 2, which is a big release in itself)
Re: Show HN: I made an app to use local AI as daily driver
#135Earlier quoted context omitted.
Sure, I use one system prompt template to make ChatGPT be more concise. Compare these two: https://sharegpt.com/c/fEZKMIy vs https://sharegpt.com/c/S2lyYON I use similar ones to get ChatGPT to be more thorough or diligent as well. From my limited experience with local models, this type of system prompting is even more important than with ChatGPT 4.
Is there a difference in using a system prompt and just pasting the "system prompt" part at the beginning of your message?
Haven't tested, but having it built-in is more convenient, and convenience is why I'm using these tools in the first place (as a replacement for StackOverflow, for example).
Re: Show HN: I made an app to use local AI as daily driver
#136Earlier quoted context omitted.
It's very nice that there exists something like that. I am an author of one of the similar apps [1] someone listed in a different thread. I was hoping I could get in touch with someone like you who could give me some feedback on how to make my app more accessible for users like you. I really want to it be an "LLM for all" kind of app but despite my best efforts and intention, I suck at it. Any chance of getting in to…
Sure, I'll probably join the discord tomorrow morning, but a few notes: * For apps like this, using live regions to speak updates may be helpful. either that or change the buttons, like from "download local AI" to "configuring." Maybe a live region would be best for that one since sighted people would probably be looking near the bottom for the status bar, but anyway... * Using live regions for chats is pretty import…
Wow! This is already very helpful and was the kind of feedback I was looking for. Thank you!
Re: Show HN: I made an app to use local AI as daily driver
#137Will this work on an M1 Mac Book Air? Looking for an offline solution like this but wary of hardware requirements.
Re: Show HN: I made an app to use local AI as daily driver
#138Earlier quoted context omitted.
I have doubts about that. Most personal data actually lives in the cloud these days. If you need your Gmail emails, you'll need to use their API which is guarded behind $50k certification fee or so. I think there is a simpler version for personal use, but you still need to get the API key. Who's going to teach their mom about API keys? So I think for a lot of these data sources you'll end up with enterprise AIs integ…
Seconding a sibling question: What $50k API fee? To access your gmail? I've been using gmail since 2008 or so without ever touching their web/app interface or getting an API key. You just use it as an IMAP server.
To use Google's sensitive APIs in production you have to certify your product and that costs tens of thousands. To be honest, didn't think about imap at first, but it looks like that could be getting tougher soon too https://support.google.com/a/answer/14114704?hl=en. Soon they will require oAuth for imap and with oAuth you'll need the certification: https://developers.google.com/gmail/imap/xoauth2-protocol. If it's for personal use, you might be able to get by with just with some warnings in the login flow but it won't be easy to get oAuth flow setup in the first place.
Re: Show HN: I made an app to use local AI as daily driver
#139Honest question - can it be used for programming? Or anyone maybe can recommend local-first development LLM which would take in all project (Python / Angular) and write code based on full repo, not only the active window as with Copilot or Jetbrains AI
Have you tried using Copilot's @workspace command in the chat?
Re: Show HN: I made an app to use local AI as daily driver
#140> Thanks to the amazing work of @ggerganov on llama.cpp which made this possible. If there is anything that you wish to exist in an ideal local AI app, I'd love to hear about it. The app looks great! Likewise, if you have any requests or ideas for improving llama.cpp, please don't hesitate to open an issue / discussion in the repo
Did not expect to see the Georgi Gerganov here :) How is GGML going? Поздрави!
So far is going great! Good community, having fun. Many ideas to explore :-)