Live data from Hacker News

Viewing profile — retakeming

retakeming

HN member
Joined
Thu, Mar 16, 2023, 6:33 PM UTC
HN karma
109
Public activity
30 items

About retakeming

No profile information was provided.

Recent public activity

  1. comment
  2. comment
    Comment #44637868

    What would you say is the most neutral oil then?

  3. comment
    Comment #43628811

    The segments themselves being immutable doesn't mean that Tantivy is incompatible with Postgres - it just means that Tantivy needs to be made compatible with Postgres' concurrency …

  4. comment
    Comment #43628788

    I'm one of the pg_search maintainers. Hello! A few thoughts. First, both strategies - the one outlined by the Neon/ParadeDB article, and the one used here -- are presented as viabl…

  5. comment
    Comment #41177666

    Good question. That was from a very old version of pg_bm25 (since renamed to pg_search). BM25 indexes are now strongly consistent.

  6. comment
    Comment #41176431

    If you're a Postgres pg_search user, partial indexes ( https://docs.paradedb.com/search/full-text/index#partial-bm2... ) can solve.

  7. comment
    Comment #40527737

    pg_search (full text search Postgres extension) can be used with pgvector for hybrid search over Postgres tables. It comes with a helpful hybrid search function that uses relative …

  8. comment
    Comment #40355354

    Could you clarify which result you're referring to as the baseline and "number 1 place?" I should clarify that our published Clickbench results are from our pg_analytics extension.…

  9. comment
    Comment #40348280

    pg_house just wasn't as catchy! In all seriousness though, I see your point. While it's true that we don't provide the storage or table format, our belief is that companies actuall…

  10. comment
    Comment #40348110

    Thanks! 1. It's single node, but DataFusion parallelizes query execution across multiple cores. We do have plans for a distributed architecture, but we've found that you can get ~v…

  11. comment
    Comment #40348057

    Whereas pg_analytics stores the data in Postgres block storage, pg_lakehouse does not use Postgres storage at all. This makes it a much simpler (and in our opinion, more elegant) e…

  12. comment
    Comment #40347629

    This is anecdotal, but I feel that we (ParadeDB) have received more requests for Iceberg integration vs. Delta Lake. We were actually hesitant to launch pg_lakehouse without Iceber…

  13. story
  14. comment
    Comment #39294085

    Datafusion and Deltalake abstract away most of Arrow/Parquet. And those APIs were very nice to work with.

  15. comment
    Comment #39293153

    Datafusion's SQL dialect has some slight quirks that pertain to Datafusion-specific functionality. For instance, the ability to create an external table. With regards to ParadeDB, …

  16. comment
    Comment #39293056

    Yes and no, depending on what you mean. The custom types/indexes introduced by PostGIS won't work with deltalake tables. Even if it were possible, the benefits of using deltalake t…

  17. comment
    Comment #39292920

    Sort ordering is handled automatically by Datafusion. Collations at the column/operation level are not yet supported but we're working on it.

  18. comment
    Comment #39292772

    Yes. delta-rs is a Rust-based implementation of Delta Lake. The existing version of pg_analytics uses delta-rs to manage Parquet files stored within Postgres. In the future, we pla…

  19. comment
    Comment #39292710

    One of the authors of pg_analytics here. 1. On Clickbench, make sure you're doing an apples-to-apples comparison by comparing scores from the same instance. We used the most common…

  20. story
  21. comment
    Comment #39179684

    On Clickbench, ParadeDB load times are 1.85x faster than Postgres. Typically, you would expect slower inserts if you were using an index to accelerate queries since inserting into …

  22. comment
    Comment #37814309

    Thanks! We released support for metrics aggregations a few days ago, including count: https://docs.paradedb.com/aggregations/metrics#count . We haven't gotten around to benchmarkin…

  23. comment
    Comment #37812375

    Blog post author and one of the pg_bm25 contributors here. Super excited to see the interest in pg_bm25! pg_bm25 is our first step in building an Elasticsearch alternative on Postg…

  24. comment
    Comment #37557423

    Hey HN - lead dev on pg_bm25 here. To provide a bit more context: the goal of pg_bm25 is to make BM25-based full text search feel native to Postgres. pg_bm25 is built on Tantivy, a…

  25. comment
    Comment #37181122

    This looks neat. https://github.com/ShishirPatil/gorilla feels like a project with certain similarities here. How would you compare yourselves to them?