Retrieval Augmented Generation Based on SQLite
1–10 of 13 posts
Re: Retrieval Augmented Generation Based on SQLite
#2[deleted]
Re: Retrieval Augmented Generation Based on SQLite
#3This looks cool, and I'm interested in these keywords, but I read the entire readme and I'm still unsure what problem it's actually solving.
Anyone want to help out?
Re: Retrieval Augmented Generation Based on SQLite
#4This looks cool, and I'm interested in these keywords, but I read the entire readme and I'm still unsure what problem it's actually solving. Anyone want to help out?
This is for LLMs. In general RAG takes a user prompt and uses it to find potentially relevant documents in the database. It then enriches the original prompt with those documents so that the LLM has context that wasn't in its training dataset.
Re: Retrieval Augmented Generation Based on SQLite
#5This looks cool, and I'm interested in these keywords, but I read the entire readme and I'm still unsure what problem it's actually solving. Anyone want to help out?
RAG -> Vector search -> means that your documents are not indexed as full text but as Vectorized objects which mean that then you can search using concepts instead of exacts strings you would use with a regular "Fulltext search".
This makes the search less precise and more powerful at the same time (ie it could look clever to some extent).
Re: Retrieval Augmented Generation Based on SQLite
#6Sqlite has an embedding search? Or is that being provided by this tool?
Re: Retrieval Augmented Generation Based on SQLite
#7Sqlite has an embedding search? Or is that being provided by this tool?
It's provided via https://github.com/asg017/sqlite-vec
Re: Retrieval Augmented Generation Based on SQLite
#8This and SQLite-vec (or whatever extension is trendy these days) can do a lot in a very limited amount of compute.
Re: Retrieval Augmented Generation Based on SQLite
#9Would love to see a system that blends cheap lexical (Fulltext Search) or semantic/vector search using SQLite and chooses the best approach given the input.
Re: Retrieval Augmented Generation Based on SQLite
#10Would love to see a system that blends cheap lexical (Fulltext Search) or semantic/vector search using SQLite and chooses the best approach given the input.
If you want the best possible solution vertical for most business, I'd be looking at using Lucene for FTS duty.
Having the FTS engine provide a google-style snippet of the most relevant document chunk is the holy grail for RAG applications. Lucene does this kind of thing better than anyone else:
https://lucene.apache.org/core/8_0_0/highlighter/org/apache/...
It is also very easy to customize this engine and align the document tokenization & indexing concerns with your specific retrieval scenarios.