Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made an app to use local AI as daily driver

recurse.chat

Post reply on HN
Print view View original

81–90 of 246 posts

Re: Show HN: I made an app to use local AI as daily driver

#81

Post by Gunnerhead »

chown wrote: post #63
Gunnerhead wrote: post #61

Earlier quoted context omitted.

I’m looking for a ChatGPT client alternative, i.e. I can use my own OpenAI API key in some other client. Offline isn’t important for me, only that $20 is a lot of money, when I’d wager most months my usage is a lot less. However, I’d still want access to completion, DALL-E, etc. Would Msty be a good option for me?

Give it a try and see how you feel. "Yes, it will" be a dishonest answer to be completely honest at least at this point. The app has been out for just about a month and I am still working in it. I would love a user like you to give it a try and give me some feedback (please). I am very active on our Discord if you want to get in touch (just mention your HN username and I will wace).

Thank you so much, I’m excited to give this a try in the next few days.

Re: Show HN: I made an app to use local AI as daily driver

#82

Post by 8n4vidtmkvmk »

refulgentis wrote: post #48
iansinnott wrote: post #27

Earlier quoted context omitted.

You can update the system prompt in the settings. Admittedly this is not mentioned in the README, but is customizable.

> the system prompt There isn't a singular system prompt. It really does matter! Copy the OpenAI playground, you'll thank yourself later

You use multiple system prompts in a single chat? What for?

Re: Show HN: I made an app to use local AI as daily driver

#83

Post by [deleted] »

pentagrama wrote: post #38

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev (AI Characters): No U…

[deleted]

Re: Show HN: I made an app to use local AI as daily driver

#84

Post by theolivenbaum »

pentagrama wrote: post #38

Sadly I can't try this because I'm on Windows or Linux. Was testing apps like this if anyone is interested: Best / Easy to use: - https://lmstudio.ai - https://msty.app - https://jan.ai More complex / Unpolished UI: - https://gpt4all.io - https://pinokio.computer - https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generat... - https://github.com/LostRuins/koboldcpp Misc: - https://faraday.dev (AI Characters): No U…

We just added local LLM support to our curiosity.ai app too - if anyone wants to try we're looking for feedback there!

Re: Show HN: I made an app to use local AI as daily driver

#85

Post by xyc »

ssnri wrote: post #53
xyc wrote: post #13

Earlier quoted context omitted.

Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.

I would even let it have longer processing times for queries to apply against each document in my system, allow it to specialize/train itself on a daily basis… Use all the resources you want if you save me brainpower

Agree, there's a non real-time angle to this.

Re: Show HN: I made an app to use local AI as daily driver

#87

Post by xyc »

tkgally wrote: post #4

For an app like this, I would really like a spoken interface. Any possibility of adding text-to-speech and speech-to-text so that users can not only type but also talk with it?

yes I wish it could talk. It's after other priorities though, but I might try something experimental.

Re: Show HN: I made an app to use local AI as daily driver

#88

Post by xyc »

scottrblock wrote: post #29
girishso wrote: post #8

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

plus one, I would love to configure a folder of markdown/txt(+ eventually images and pdfs) files that this can have access to. Ideally it could RAG over them in a sensible way. Would love to help support this!

Thank you! I'd love to learn more about your use cases. Would you mind sending an email to feedback@recurse.chat or DM me on https://x.com/chxy to get the conversation started?

Re: Show HN: I made an app to use local AI as daily driver

#89

Post by xyc »

SkepticMystic wrote: post #69

I've found great utility with `llm` https://llm.datasette.io , a CLI to interact with LLMs. It has plugins for remote and local models.

Good to know. I've learned lots of things from Simon Willison's blog (datasette's author), so can't imagine llm being unuseful.

Re: Show HN: I made an app to use local AI as daily driver

#90

Post by xyc »

madduci wrote: post #72
xyc wrote: post #70

Earlier quoted context omitted.

Thanks so much for the kind words and giving it a spin! Feel free to send feedback, issues, feature suggestion as you use it more, I'm all ears. My twitter DM is also open: https://x.com/chxy .

Any chance to see it available on other operating systems as well?

Unfortunately not now. If you are interested in email updates: https://tally.so/r/wzDvLM
Post reply on HN