Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Arroyo – Write SQL on streaming data

github.com

Post reply on HN
Print view View original

31–35 of 35 posts

Re: Show HN: Arroyo – Write SQL on streaming data

#31

Post by ryzhyk »

sorenbs wrote: post #12

This is a really exciting project! I recently learned about https://github.com/vmware/database-stream-processor which builds on a new theoretical foundation and claims to be 9x faster than Flink. It is also written in Rust, and there is a compiler from SQL to Rust executables. Can you comment on the differences?

I'm a developer of DBSP. Our repo now lives here: https://github.com/feldera/dbsp/. And here is some more benchmarking data vs Flink and Beam: https://github.com/feldera/dbsp/tree/main/benchmark.

See feldera.com for more info.

Re: Show HN: Arroyo – Write SQL on streaming data

#33

Post by necubi »

yevpats wrote: post #32

Looks cool. What is the difference between this tools and benthos ( https://www.benthos.dev/ )?

There's a spectrum of streaming systems from simple, stateless processors to complex, stateful distributed processors.

I'm not very familiar with Benthos, but it appears to be on the simple, stateless end. Systems like that can be great if they fit your use cases—they tend to be much easier to understand and operate.

But they are not as flexible or powerful as stateful systems like Arroyo or Flink. For example, they cannot accurately compute aggregations, joins, or windows over long time ranges.

Re: Show HN: Arroyo – Write SQL on streaming data

#34

Post by gunnarmorling »

Very interesting project, Arroyo has been on my watch list for a while! How would you say does Arroyo compare to Apache Flink, i.e. what are pros and cons? For instance, given it's implemented in Rust, I'd assume Arroyo's resource consumption might be lower?

(Disclaimer: I work for Decodable, where we build a SaaS based on Flink)

Re: Show HN: Arroyo – Write SQL on streaming data

#35

Post by sorenbs »

ryzhyk wrote: post #31
sorenbs wrote: post #12

This is a really exciting project! I recently learned about https://github.com/vmware/database-stream-processor which builds on a new theoretical foundation and claims to be 9x faster than Flink. It is also written in Rust, and there is a compiler from SQL to Rust executables. Can you comment on the differences?

I'm a developer of DBSP. Our repo now lives here: https://github.com/feldera/dbsp/ . And here is some more benchmarking data vs Flink and Beam: https://github.com/feldera/dbsp/tree/main/benchmark . See feldera.com for more info.

Thank you!

Really happy to see all the activity at the new repo. For a while there I thought the project was dying...

Post reply on HN