[flagged]
Ask HN: Best Embedding Models?
11–20 of 20 posts
Re: Ask HN: Best Embedding Models?
#12Feels like embeddings are underrated compared to LLM's hype, but they doing great.
Why do you feel like embeddings are underrated? What is it with embeddings that deserves more attention?
Re: Ask HN: Best Embedding Models?
#13Just fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
Re: Ask HN: Best Embedding Models?
#14Cohere's embed-v4.0 is my daily driver as far as a high performance model is concerned. I do a lot of cluster analysis and data visualization and I like that there's an `input_type="clustering"` mode in addition to the standard `input_type="search"` mode.
For a fast, open, and local model, I've found it hard to beat https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...
Re: Ask HN: Best Embedding Models?
#15Meta's Perception Encoder Audio-Visual, its CLIP like but has three modality: Audio, Video and Text
Re: Ask HN: Best Embedding Models?
#16I am using openai small embedding model with custom compression. It is super cheap. You can read more at https://corvi.careers/blog/vector-search-embedding-compressi...
Re: Ask HN: Best Embedding Models?
#17Just fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
What top K do you use for vector search before passing into the reranker?
Re: Ask HN: Best Embedding Models?
#18Just fyi, for RAG/similarity search, adding a reranker was much bigger pay off than switching embedding models.
What top K do you use for vector search before passing into the reranker?
At a minimum, you increase top-k to cast a wider net, then after reranking, take the N you really want. You have to play around with it a bit, but that’s the idea.
Re: Ask HN: Best Embedding Models?
#19please check OpenAI embedding models - especially small one
Re: Ask HN: Best Embedding Models?
#20not a single "of what data" or "in what env"
best in what?