I thought the author was bringing in genAI for little reason...then I clicked through. For some reason storing vectors and chats is core to Redis' vision of its future. ( https://redis.io/blog/the-future-of-redis/ ) I'm, generally, a mobile dev so I'm not familiar with redis. My handwave-y understanding is its a in-memory key/value DB. I don't understand how that brings anything to the table for genAI. Couldn't the p…
A vector DB is the complete opposite of what you describe, it maps list to pair . The queries it's good at are not "what vectors map to this filename", but "what pieces of text are closest to this vector, and what metadata do we have about them?" This is a non-trivial problem to solve if you don't want your queries to be O(n) where n is the dataset size. This is useful because AI models can transform any kind of cont…
I think we're getting to the heart of my confusion, and I only assume it's because of different use cases/expectations on privacy.
Lets say I'm CEO of Mousetrap Inc., and I got this .txt file, our top secret plan for a better mousetrap.
I want genAI to pick out the parts about the new metal alloy.
I upload the file to B2BAI LLC, who turns it into List, then we give it to the model and get back List>.
Vector DBs store the List and the List> for retrieval.
I, the top secret mouse-trap inventor, do not want my plan stored on any 3rd party computer.
But, this app I use puts it in an a16z approved Vector DB™.
The vector DB provider now has the embeddings (List>) and the chunks (List), which violate my desire to not have my top secret mousetrap plan stored at rest anywhere .