Live data from Hacker News

Viewing profile — shortishly

shortishly

HN member
Joined
Fri, Sep 06, 2024, 1:14 PM UTC
HN karma
4
Public activity
8 items

About shortishly

No profile information was provided.

Recent public activity

  1. comment
    Comment #46754216

    You could use the proxy to spread topics over a number of brokers. The broker and proxy share a number of services and layers, that could be used to route: https://blog.tansu.io/ar…

  2. comment
    Comment #46753837

    I agree that it isn't straight forward! Tansu uses the JSON protocol descriptors from Apache Kafka, generating ~60k LoC of Rust to represent the structures. It then uses a custom S…

  3. comment
    Comment #46752638

    Yes: with a schema backed topic (AVRO, JSON or Protocol buffer) Tansu can write to Apache Iceberg, Delta or Parquet. You can use a Sink topic to write directly to an open table for…

  4. comment
    Comment #46751769

    Tansu author here. Storage is a pluggable choice of: PostgreSQL, memory, SQLite or S3. There are others in the pipeline (SlateDB, ...).

  5. story
    Show HN: Tansu – Kafka Compatible Broker Transforms Proto/Avro/JSON into Parquet

    What is it? - Tansu is an Kafka compatible broker with S3 or PostgreSQL storage - Broker schema validation of Proto/Avro/JSON backed topics - Proto/Avro/JSON backed topics are also…

  6. story
  7. comment
  8. story