Live data from Hacker News

Viewing profile — generall

generall

HN member
Joined
Sat, Feb 15, 2020, 10:23 PM UTC
HN karma
59
Public activity
33 items

About generall

Hi, it's Andrey

I'm a Machine Learning Engineer. I prefer practical over theoretical, working demo over arXiv paper.

Recent public activity

  1. story
  2. comment
    Comment #42538939

    In this scenario posting list have to share all the same attributes as each element inside the list.

  3. comment
    Comment #42500499

    In IVF you can start checking conditions only in the final bucket. There are no guarantees if the bucket has any acceptable value, and there are no procedures to find the bucket wh…

  4. comment
    Comment #42497271

    IVF, unfortunately, is barely compatible with filtered search. It have to rely on post-filtering and retrieve more and more candidates if the result set is not big enough. If the q…

  5. story
  6. story
  7. comment
    Comment #38613613

    https://qdrant.tech/articles/dedicated-service/ - we have some arguments on this

  8. comment
    Comment #37695327

    This article contains a lot of inaccuracies. Based on your statements, like > Qdrant stores both the vectors and the metadata in a sqlite database. It looks like you have benchmark…

  9. comment
    Comment #37150740

    With a few optimization tricks, TL;DR: - ONNX inference in Rust - Embeddings cache & lookup - Parallel & Batch requests - hybrid search with full-text filtering + vector re-scoring…

  10. story
  11. story
  12. comment
    Comment #37048287

    I would say that text text and vector search are orthogonal. Some scenarios are better with one, others with combination. But fitting vector search into the interface designed for …

  13. story
  14. story
  15. comment
    Comment #35061099

    Benchmark is open source - https://github.com/qdrant/vector-db-benchmark You are welcome to fork it and make your own measurements, if you suspect something. Benchmarks like https:…

  16. comment
    Comment #35058210

    > Please expand on how you are defining full text search distinctly from sparse search to continue the discussion In addition to the indexing algorithm, there is the tokenizer, whi…

  17. comment
    Comment #35056820

    > There are a few arguments why adding sparse search doesn't require too much extra specialization Full-text search != sparse search, that's a naive oversimplification. Btw, sparse…

  18. comment
    Comment #35054940

    Proposed architecture doesn't limit you to use self-hosted transformers only, you can use OpenAI just as easily. And you don't need a to install a "module" for that

  19. comment
    Comment #35054794

    The latency of the combination of parallel systems is equal to the slowest component. And obviously, specialized tools will be faster than a component of a multi-tool system cause …

  20. comment
    Comment #32727841

    There is more relevant benchmark of vector search engines end-to-end, not just algorithms: https://qdrant.tech/benchmarks/

  21. story
  22. comment
    Comment #32085994

    PML is a great collection of implementations, but not the best framework. Also you can use PML with Quaterion: https://github.com/qdrant/quaterion/blob/master/examples/tra...

  23. comment
    Comment #32083957

    Starting from 0.5.0 finetuner is no longer an open-source. > From 0.5.0, Finetuner computing is hosted on Jina Cloud. The last local version is 0.4.1, one can install it via pip or…

  24. comment
    Comment #32083617

    It is definitely possible to do, if you have a proper training set. You would need to somehow give model a signal, that you are interesting in e.g. arguing style specifically, and …

  25. comment
    Comment #32083427

    The idea is to fine-tune model, which can be used to produce embeddings required for Qdrant. Our design approach is to make things as modular as possible, so you can use framework …