21–30 of 143 posts
Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0] [0] https://github.com/imartinez/privateGPT
The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
Once the vectors are created tho, you're completely off the cloud if you so choose.
You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes.
Everything else is already using huggingface here and can be swapped out for any other model besides GPT2 which supports the prompts.
Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0] [0] https://github.com/imartinez/privateGPT
The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
The only OpenAI 'crap' being used here is to generate the embeddings. Right now, OpenAI has some of the best and cheapest embeddings possible, especially for personal projects. Once the vectors are created tho, you're completely off the cloud if you so choose. You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes. Everything else is already using huggingface here…
Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0] [0] https://github.com/imartinez/privateGPT
[flagged]
https://www.nytimes.com/2023/05/30/technology/ai-threat-warn...
https://www.theguardian.com/technology/2023/may/10/ai-poses-...
https://www.theguardian.com/technology/2023/may/30/risk-of-e...
https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-...
The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
Here is my premise: We are past the wonder stage. I want to actually get stuff done efficiently. From what I have tested so far, the only model that allows me to do that halfway reliably is GPT-4.
Am I incompetent or are we really just wishfully thinking in HN spirit that other LLMs are a lot better at being applied to actual tasks that require a certain level of quality, consistency and reliability?
The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
- Pay openai less than $50mo
- Manage cloud gpus, hire ml engineers > $1000/mo
- Buy a local 4090 and put it under someone's desk, $no reliability +$1500 fixed
Any larger business will need scalability and you still can't compete with openai pricing.
Maybe one of you startup inclined people can make an openllama startup that charges by request and allows for finetuning, vector storage