Show HN: I made an app to use local AI as daily driver

Post by boringg » Wed, Feb 28, 2024, 2:44 PM UTC

Post by ItsMattyG » Wed, Feb 28, 2024, 2:54 PM UTC

wodow wrote: post #165

domano wrote: post #163

Hey, i bought it, nice work! A few things: * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Such a chat ui is not usable for me without this feature. * The feedback button does nothing for me, just changes focus to chrom…

> * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Agreed, but what I would also really like (from this and ChatGPT) would be branching: take a conversation in two different ways from some point and retain the seperate a…

Post by machiaweliczny » Wed, Feb 28, 2024, 2:58 PM UTC

tveita wrote: post #157

danielovichdk wrote: post #149

Earlier quoted context omitted.

I dont get it. To my understanding it takes huge amounts of data to build any any form of RAG. Simply because it enlarges the statistical model you later prompt. If the model is not big enough how would you expect it to answer you in a non qualifying matter ? It simply can't. So I don't really buy it and I have yet to see it work better than any rdbms search index. Tell me I am wrong, I would like to see a local mode…

RAG doesn't require much data or involve any training, it is a fancy name for "automatically paste some relevant context into the prompt" Basically if you have a database of three emails and ask when Biff wanted to meet for lunch, a RAG system would select the most relevant email based on any kind of search - embeddings are most fashionable, and create a prompt like """Given this document: , answer the question "When…

Post by FredPret » Wed, Feb 28, 2024, 2:59 PM UTC

shanusmagnus wrote: post #177

wodow wrote: post #165

Earlier quoted context omitted.

> * The main thing that makes ChatGPTs ui useful to me is the ability to change any of my prompts in the conversation & it will then go back to that part of the converation and regenerate, while removing the rest of the conversation after that point. Agreed, but what I would also really like (from this and ChatGPT) would be branching: take a conversation in two different ways from some point and retain the seperate a…

1000 upvotes for you. My brain can't compute why someone hasn't made this, along with embeddings-based search that doesn't suck.

Post by devinprater » Wed, Feb 28, 2024, 3:39 PM UTC

karolist wrote: post #179

devinprater wrote: post #62

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me. https://github.com/chigkim/VOLlama/

Hey. I'm sorry about your condition. I feel I'm approaching blindness eventually, this is very random, but perhaps you could share any resources I could learn to prepare for this so I could continue using the web when/if it happens.