Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made an app to use local AI as daily driver

recurse.chat

Post reply on HN
Print view View original

61–70 of 246 posts

Re: Show HN: I made an app to use local AI as daily driver

#61

Post by Gunnerhead »

chown wrote: post #58
lolpanda wrote: post #52

Earlier quoted context omitted.

Oh thanks! didn't know there are quite a few ChatGPT local alternatives. I was wondering what users they are targeting. Engineers or average users? I guess average users will likely choose ChatGPT and Perplexity over local apps for more recent knowledge of the world.

Hi. I'm the author of Msty app, 2nd on the list above. You are right about average users likely choosing ChatGPT over local models. My wife was the first and the biggest user of my app. A software engineer by profession and training but she likes to not worry about LLM world and just to use it as a tool that makes you more productive. As soon as she took Msty for a ride, I realized that some users, despite their back…

I’m looking for a ChatGPT client alternative, i.e. I can use my own OpenAI API key in some other client.

Offline isn’t important for me, only that $20 is a lot of money, when I’d wager most months my usage is a lot less. However, I’d still want access to completion, DALL-E, etc.

Would Msty be a good option for me?

Re: Show HN: I made an app to use local AI as daily driver

#62

Post by devinprater »

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me.

https://github.com/chigkim/VOLlama/

Re: Show HN: I made an app to use local AI as daily driver

#63

Post by chown »

Gunnerhead wrote: post #61
chown wrote: post #58

Earlier quoted context omitted.

Hi. I'm the author of Msty app, 2nd on the list above. You are right about average users likely choosing ChatGPT over local models. My wife was the first and the biggest user of my app. A software engineer by profession and training but she likes to not worry about LLM world and just to use it as a tool that makes you more productive. As soon as she took Msty for a ride, I realized that some users, despite their back…

I’m looking for a ChatGPT client alternative, i.e. I can use my own OpenAI API key in some other client. Offline isn’t important for me, only that $20 is a lot of money, when I’d wager most months my usage is a lot less. However, I’d still want access to completion, DALL-E, etc. Would Msty be a good option for me?

Give it a try and see how you feel. "Yes, it will" be a dishonest answer to be completely honest at least at this point. The app has been out for just about a month and I am still working in it. I would love a user like you to give it a try and give me some feedback (please). I am very active on our Discord if you want to get in touch (just mention your HN username and I will wace).

Re: Show HN: I made an app to use local AI as daily driver

#64

Post by chown »

joshmarinacci wrote: post #57
pentagrama wrote: post #38

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev (AI Characters): No U…

Do any of these let you dump in a bunch of your own documents to use as a corpus and then query and summarize them ?

Author of Msty here. Not yet but I am already working on the design for it to be added in very near future. I am happy to chat more with you to understand your needs and what you are looking in such apps. Please hop on the Discord if you don't mind :)

Re: Show HN: I made an app to use local AI as daily driver

#65

Post by visarga »

android521 wrote: post #36

how big is the local model? what is the Mac spec requirement? I don't want to download and find out it won't work in my computer. It seems like the first question everyone would ask and should be addressed on the website.

It uses ollama which is based on llama.cpp, and adds a model library with dozens of models in all quant sizes.

Re: Show HN: I made an app to use local AI as daily driver

#66

Post by visarga »

pentagrama wrote: post #38

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev (AI Characters): No U…

Add Open-WebUI (used to be Ollama-WebUI)

https://github.com/open-webui/open-webui

a well featured UI with very active team

Re: Show HN: I made an app to use local AI as daily driver

#67

Post by xyc »

bradnickel wrote: post #45
bradnickel wrote: post #41

Love this! Just purchased. I am constantly harping on decentralized AI and love seeing power in simplicity. Are you on Twitter, Threads, Farcast? Would like to tag you when I add you to my decentralized AI threads.

Found your Twitter account in a previous post. Just tagged you.

Awesome, thanks for the tag!

Re: Show HN: I made an app to use local AI as daily driver

#68

Post by chown »

devinprater wrote: post #62

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me. https://github.com/chigkim/VOLlama/

It's very nice that there exists something like that. I am an author of one of the similar apps [1] someone listed in a different thread. I was hoping I could get in touch with someone like you who could give me some feedback on how to make my app more accessible for users like you. I really want to it be an "LLM for all" kind of app but despite my best efforts and intention, I suck at it. Any chance of getting in touch with you and get some feedback? Only if you want and have time, no pressure at all.

[1] https://msty.app

Re: Show HN: I made an app to use local AI as daily driver

#70

Post by xyc »

cooper_ganglia wrote: post #60

I read the website for 30 seconds and instantly bought it. It's clean, easy to use, and works really well! Easy local server hosting was cool, too. I've used the other LLM apps, and this feels like those, but simplified. It just feels good to use. I like it a lot! I'm gonna test drive it for a while, and if I keep using it regularly, I'll definitely be sending in some feedback. Other users have made a lot of really g…

Thanks so much for the kind words and giving it a spin!

Feel free to send feedback, issues, feature suggestion as you use it more, I'm all ears. My twitter DM is also open: https://x.com/chxy.

Post reply on HN