Live data from Hacker News

Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

github.com

31–40 of 47 posts

Re: Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

#31
post #5

Author here. For context, I was the tech lead for the Postgres team at Cloudflare, and this came directly out of a challenge I kept hitting there: BI and dashboard teams needed to run long-running analytical queries, and the answer was always to spin up another bespoke read replica or stand up an ETL dump into an analytical database and query that. So the question I started with was: what's the fewest components I co…

How does it compare to https://github.com/supabase/etl ?

Re: Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

#34
post #5

Author here. For context, I was the tech lead for the Postgres team at Cloudflare, and this came directly out of a challenge I kept hitting there: BI and dashboard teams needed to run long-running analytical queries, and the answer was always to spin up another bespoke read replica or stand up an ETL dump into an analytical database and query that. So the question I started with was: what's the fewest components I co…

Why are your queries slow?

Re: Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

#36

vira28: It looks like nearly all of your responses to comments/questions here are flagged/dead. Probably because they all look AI written. Are you actually responding or do you have an agent answering questions for you?

I wouldn't be surprised, even the the core of the project is heavily vibe-coded[0]

[0] https://github.com/viggy28/streambed/blob/a660ebb75b4744f5bd...

Re: Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

#37
post #5

Author here. For context, I was the tech lead for the Postgres team at Cloudflare, and this came directly out of a challenge I kept hitting there: BI and dashboard teams needed to run long-running analytical queries, and the answer was always to spin up another bespoke read replica or stand up an ETL dump into an analytical database and query that. So the question I started with was: what's the fewest components I co…

Hey vira28, thanks a lot for your work. This is a very promising project because other alternative like supabase/etl, Kuvasz-streamer, Sequin all have some subtle issues.

Few questions: 1) For a supabase project can we setup replication slot on replica instead of primary? https://sequinstream.com/docs/reference/databases#using-sequ...

2) For a planetscale cluster are the replication slots on primary or the follower nodes?

I'm asking because isn't setting up slots on primary riskier than setting them on replicas/followers? Because If you have them primary In case of WAL buildup your primary will go down?

Re: Show HN: Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

#38
post #5

Author here. For context, I was the tech lead for the Postgres team at Cloudflare, and this came directly out of a challenge I kept hitting there: BI and dashboard teams needed to run long-running analytical queries, and the answer was always to spin up another bespoke read replica or stand up an ETL dump into an analytical database and query that. So the question I started with was: what's the fewest components I co…

[dead]
Post reply on HN