[dead]
Is it private if it's using ChatGPT?
PrivateGPT
41–50 of 147 posts
Re: PrivateGPT
#42Earlier quoted context omitted.
Yes, it could be dangerous if you blindly rely on its reliability for something safety-related. But many creative processes are unreliable. For example, coming up with bad ideas while brainstorming is pretty harmless if nobody misunderstands it. Generally, you want some external way of verifying that you have something useful. Sometimes that happens naturally. Ask a chatbot to recommend a paper to read and then searc…
What happens when the tech isn't only being used to answer a human's questions during a shortlived conversation though? The common case we see publicized today is people poking around with prompts, but isn't it more likely, or at least a risk, that mass adoption will look more like AI running as longlived processes talked with managing done system on their own?
> The common case we see publicized today is people poking around with prompts, but isn't it more likely, or at least a risk, that mass adoption will look more like AI running as longlived processes talked with managing done system on their own?
If by “AI” you mean “bare GPT-style LLMs”, no, they can’t do that.
If you mean “systems consisting of LLMs being called in a loop by software which uses a prompt structure carefully designed and tested for the operating domain, and which has other safeguards on behavior, sure, that’s more probable.
Re: PrivateGPT
#43I posted it 9 days ago and somehow this one gets the attention. The same freaking post. Unbelievable
Re: PrivateGPT
#44I posted it 9 days ago and somehow this one gets the attention. The same freaking post. Unbelievable https://news.ycombinator.com/item?id=35914810
Day and time when you post something matters a lot unfortunately.
Re: PrivateGPT
#45Re: PrivateGPT
#46So many good links here, thanks to the OP for sharing, and to all commenters as well!
Re: PrivateGPT
#47Wow. I keep a personal Wiki, Journal and use plain text accounting...
This project could help me create a personal AI which answers any questions to my life, finances or knowledge...
Re: PrivateGPT
#48Always wondering pros/cons of Chroma and Qdrant. Can someone tell me?
Chroma doesn't seem to be a real DB, it's rather a wrapper around tools like hnswlib, DuckDB or Clickhouse. Qdrant is way more mature - it has its own HNSW implementation with some tweaks to incorporate filtering directly during the vector search phase, supports horizontal and vertical scaling, as well as provides its own managed cloud offering.
In general, Qdrant is a real DB, not a library and that's a huge difference.
Re: PrivateGPT
#49Wow. I keep a personal Wiki, Journal and use plain text accounting... This project could help me create a personal AI which answers any questions to my life, finances or knowledge...
Well maybe it works on Obsidian vaults for note taking heh, but with llama models' 2k input token range it'd get a tenth of the way before starting to drop context. Likely useless without something like an 100k model.
Re: PrivateGPT
#50Always wondering pros/cons of Chroma and Qdrant. Can someone tell me?
Chroma doesn't seem to be a real DB, it's rather a wrapper around tools like hnswlib, DuckDB or Clickhouse. Qdrant is way more mature - it has its own HNSW implementation with some tweaks to incorporate filtering directly during the vector search phase, supports horizontal and vertical scaling, as well as provides its own managed cloud offering. In general, Qdrant is a real DB, not a library and that's a huge differe…
What does Chroma lack? Their APIs seem pretty much the same to me.