Live data from Hacker News

Viewing profile — zhousun

zhousun

HN member
Joined
Wed, Oct 30, 2024, 6:19 PM UTC
HN karma
17
Public activity
19 items

About zhousun

No profile information was provided.

Recent public activity

  1. comment
    Comment #44802651

    author here. I would actually second you. My core belief is "it is possible to build true database-like functionalities on top of iceberg", but it is definitely not 'easier' than b…

  2. comment
    Comment #44121786

    there's actually a great read, cursor started with a distributed OLTP solution: yugabyte, and then fall back to RDS...

  3. comment
    Comment #44108678

    Using SQL as catalog is not new (iceberg supports JDBC catalog from the very beginning). The main difference is to store metadata and stats also directly in SQL databases, which ma…

  4. comment
    Comment #43997264

    DataFile(parquet) is not enough for table with update/delete, (they are part of iceberg "metadata"). for CDC from OLTP use-cases, the pattern involves rapidly marking rows as delet…

  5. comment
    Comment #43628173

    Glab to see more 'postgres-native' full-text search implementation. Alternative solutions (lucene/ tantivy) are both designed for 'immutable segments' (indexing immutable files), s…

  6. comment
    Comment #43303334

    lol spot-on comment and stay tuned for our v2 :) The focus of mooncake is to be a columnar storage engine, that natively integrate with pg, allowing writing from pg, replicating fr…

  7. comment
    Comment #43302328

    Yep what I want say is the line between the two designs is indeed very blur. Logical replication with mooncake will try to create a columnar version of a postgres heap table, that …

  8. comment
    Comment #43301395

    Yea this is indeed a repeated pattern we saw people requesting (filter on many columns) and we are trying to solve with pg_mooncake. If you are interested, feel free to join moonca…

  9. comment
    Comment #43301235

    people tried to run spark (better hadoop) and failed lol. https://github.com/ClickHouse/ClickBench/pull/139

  10. comment
    Comment #43301221

    Thanks for the comment but you are mixing some terminologies. The core idea of mooncake is to built upon open columnar format + substitutable vectorized engine, while natively inte…

  11. comment
    Comment #43301174

    hydra/pg_duckdb embeds duckdb to query existing data on S3. So it is kind of targeting a completely different use case (someone already prepares and shared a dataset and you just w…

  12. comment
    Comment #43301140

    zhou from mooncake labs here. Good point! Normally for postgres extension it won't be solvable, but for mooncake it is actually not the case! The core idea of mooncake is to built …

  13. comment
    Comment #43301080

    transactions are also managed by postgres as if they are native table, so that you don't need to worry about coordinating commits between postgres and the S3 data.

  14. comment
    Comment #43301065

    Interesting enough, the mooncake team was building SingleStore before, and so far it is the best production-ready HTAP system. One lesson I really learned is, people don't want to …

  15. comment
    Comment #43301024

    Zhou from mooncake labs here. Mooncake is built upon open-table formats and substitutable query engines. So it don't need to be just a postgres extension. PG_mooncake will stay ope…

  16. comment
    Comment #43300985

    Hi, Zhou From Mooncake labs here. Love your work on PeerDB and it's inspiring the evolvement of pg_mooncake (logical replication will be the killing feature for V2) The core idea o…

  17. comment
    Comment #43283138

    The only datastack iceberg (or lakehouse) will never replace is OLTP systems, for high-concurrency updates optimistic concurrency control & object store is simply a no go. Iceberg …

  18. story
  19. comment
    Comment #42568996

    It's such an honor our https://pgmooncake.com/ is covered in the review! A little sad Andy didn't share more of his thoughts on the intersection between Data and AI, and how that's…