Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made an app to use local AI as daily driver

recurse.chat

Post reply on HN
Print view View original

211–220 of 246 posts

Re: Show HN: I made an app to use local AI as daily driver

#211

Post by akerl_ »

Satam wrote: post #138
noduerme wrote: post #128

Earlier quoted context omitted.

Seconding a sibling question: What $50k API fee? To access your gmail? I've been using gmail since 2008 or so without ever touching their web/app interface or getting an API key. You just use it as an IMAP server.

To use Google's sensitive APIs in production you have to certify your product and that costs tens of thousands. To be honest, didn't think about imap at first, but it looks like that could be getting tougher soon too https://support.google.com/a/answer/14114704?hl=en . Soon they will require oAuth for imap and with oAuth you'll need the certification: https://developers.google.com/gmail/imap/xoauth2-protocol . If it'…

I'm not sure what you mean.

> You will no longer use a password for access (with the exception of app passwords)

I'm not seeing anywhere that I'd need to pay money to use OAuth via an app like Thunderbird or another email client. That app would either need to support using OAuth to let the user auth and get credentials, or use an app password.

Re: Show HN: I made an app to use local AI as daily driver

#212

Post by bonestamp2 »

You will sell more if instead of telling us it's for "chatting with local AI" you tell us what we can accomplish by chatting with local AI. I don't need to chat, I need to get certain tasks done. What tasks can it do? (Don't answer me, put it on your landing page and app store listing)

Re: Show HN: I made an app to use local AI as daily driver

#213

Post by brigleb »

Cool, instant buy for me. A few little suggestions:

- Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well?

- A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going.

- Would be great if Command-comma opened settings, like most Mac apps.

- Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing!

Re: Show HN: I made an app to use local AI as daily driver

#214

Post by chown »

indit wrote: post #144
chown wrote: post #68

Earlier quoted context omitted.

It's very nice that there exists something like that. I am an author of one of the similar apps [1] someone listed in a different thread. I was hoping I could get in touch with someone like you who could give me some feedback on how to make my app more accessible for users like you. I really want to it be an "LLM for all" kind of app but despite my best efforts and intention, I suck at it. Any chance of getting in to…

Hi, I just use msty. Could it use an already downloaded gguf file?

Not right now but that’s something we plan to support soon. Supporting Ollama downloaded models is getting released either today or tomorrow, gguf support might go into the next release. Would love to chat with you to learn more about your use case. Mind saying hi on our Discord?

Re: Show HN: I made an app to use local AI as daily driver

#215

Post by xyc »

jedberg wrote: post #197

The app is great but honestly I'm impressed with the home page! Can you go into more details on how you made the home page? What did you use to make the screenshots, and are you using any tools to generate the HTML/CSS/etc?

Thanks! honestly it's a quick hack together compared to the app. screenshots are from screen.studio. website is built with https://astro.build

Re: Show HN: I made an app to use local AI as daily driver

#216

Post by samstave »

gabev wrote: post #208
samstave wrote: post #199

Earlier quoted context omitted.

Seems like this would be a good tool to build lessons on - if you could share a "class" and export a link for others to then copy the class, and expand on the lesson/class/topic into their own AI. but as a separate "class" and not fully integrated to my regular history blob? I want the ability to search all my downloaded files and organize them based on context within. Have it create a category table, and allow me to…

We're working on the ability to share folders of your knowledge so that others can search/chat across them. We've been thinking of this as a "subscription" to the creator's folder. Similar to how you might subscribe to a Spotify playlist

Or aN RSS?

Re: Show HN: I made an app to use local AI as daily driver

#217

Post by eevmanu »

bigfudge wrote: post #175
discordance wrote: post #162

Earlier quoted context omitted.

RAG: 1. First you create embeddings from your documents 2. Store that in a vector db 3. Ask what the user wants and do a search in the vector db (cosine similarity etc) 4. Feed the relevant search results to your LLM and do the usual LLM stuff with the returned embeddings and chunks of the documents

Although RAG is often implemented via vector databases to find 'relevant' content, I'm not sure that's a necessary component. I've been doing what I call RAG by finding 'relevant' content for the current prompt context via a number of different algorithms that don't use vectors. Would you define RAG only as 'prompt optimisation that involves embeddings'?

Sure thing, your RAG approach sounds intriguing, especially since you're sidestepping vector databases. But doesn't the input context length cap affect it? (chatgpt plus at 32K [0] or gpt4 via open ai at 128K [1]) Seems like those cases would be pretty rare though.

[0]: https://openai.com/chatgpt/pricing#:~:text=8K-,32K,-32K

[1]: https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turb...

Re: Show HN: I made an app to use local AI as daily driver

#218

Post by xyc »

brigleb wrote: post #213

Cool, instant buy for me. A few little suggestions: - Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well? - A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going. - Would be great if Command-comma opened settings, like most Mac apps. - Would be great if clicking web links opened Safari (or my pre…

Thank you! and thanks so much for the feature suggestions:

- Make the system font (San Francisco) an option for the UI. Maybe even SF Mono as an option as well?

Reasonable request! Won't be too hard to add

- A little more help about which model to use for beginners would be nice. Maybe just an intro screen telling you how to get going.

Yes better onboarding wizard would definitely make this easier for beginners. Don't have much capacity right now, but I'll keep this in mind.

- Would be great if Command-comma opened settings, like most Mac apps.

Nice suggestion. Will probably get to this when I add some keyboard shortcuts like new chat / search etc.

- Would be great if clicking web links opened Safari (or my preferred browser), rather than a small window that loads nothing!

Ah that's odd, it's supposed to open the link. which link do you have if you don't mind sharing? (feel free to email support@recurse.chat)

Re: Show HN: I made an app to use local AI as daily driver

#220

Post by hanniabu »

chown wrote: post #64
joshmarinacci wrote: post #57

Earlier quoted context omitted.

Do any of these let you dump in a bunch of your own documents to use as a corpus and then query and summarize them ?

Author of Msty here. Not yet but I am already working on the design for it to be added in very near future. I am happy to chat more with you to understand your needs and what you are looking in such apps. Please hop on the Discord if you don't mind :)

Some of my usecases would be summarizing a PDF report, analyzing json/csv data, upload a dev project to write a function or feature or build a UI, rename image files, categorize images, etc
Post reply on HN