Viewing profile — txtai

Excellent work! Hope to see a version that has a friendlier commercial license in the future (current version is CC-BY 4.0 NC).

If you want something similar to this that is fully downloadable and open source, check this out - https://huggingface.co/NeuML/txtai-wikipedia It's an embeddings database of Wikip…

[flagged]

SetFit is a great framework for building a text classifier. This is a pretty straight forward problem and a good fit for a standard text classifier as well. Here is an example of f…

[flagged]

txtai combines Faiss and SQLite to support similarity search with SQL. For example: SELECT id, text, date FROM txtai WHERE similar('machine learning') AND date >= '2023-03-30' GitH…

txtai combines SQLite and Faiss to enable vector search. It also does a lot more than that. https://github.com/neuml/txtai

The first comment in that article has details on the new model. Not the original author but per their testing they said they paid $70 to encode 1M records. The embeddings are 1536 …

That's up to you. Many don't want to open an account and pay in order to explore what's possible. There are LLMs available on the HF Hub, such as google/flan-t5-xl.

Starting with HF models and moving to a large model like GPT3 when the task calls for it is a good approach to take with almost all tasks.