Live data from Hacker News

Iggy.rs – building message streaming in Rust

blog.iggy.rs

51–60 of 63 posts

Re: Iggy.rs – building message streaming in Rust

#52
post #43

Built something similar in Go with a friend a few years ago. https://github.com/thibauts/styx

Nice one, looks quite similar indeed! May I ask why did you discontinue the further work?

Probably because there's a very low value in building message streaming framework once you've done the basics: how do you come to, say, a trading broker and say "your order management system could be just as fast with my other messaging framework".

He did it to learn and have fun, but finishing it to be prod-ready would require at least one user.

Re: Iggy.rs – building message streaming in Rust

#53
post #49

Really cool idea and project! There are 2 things I would need to understand before trying it out though: 1. How can I run more than one instance of the server? 2. When running more than one instance of the server, how would the filesystem interaction work between servers?

This is mentioned in the blog post:

    Running as a single node (no cluster support yet)
If cluster is supported, I think this can compete with Kafka

Re: Iggy.rs – building message streaming in Rust

#55
post #46

I'm not quite sure how this compares to Kafka and fluvio [1], a Kafka competitor also written in Rust? Is it more of a message queue like rabbitmq? [1] https://www.fluvio.io/

Doesn't Fluvio aim to replace both Flink and Kafka? I just heard about it so I am trying to understand.

I lead product at Fluvio.

If I remember correctly, I had seen iggy.rs in one of the recent applicant resumes to one of our Senior Rust Developer roles. Iggy seems like a cool project. All the best for the future of Iggy.

Fluvio has been in open source development for nearly 5 years now. The team has written hundreds of thousands of lines of code.

Fluvio core is a complete distributed streaming system for unbounded stream processing that is reliable, scalable, self healing. It’s the Kafka bit.

The Flink bit is our Stateful Service Development Kit which is currently in Dev Preview. Stateful Service Development Kit offers a scaffolding to compose complex chained event driven data pipelines.

Once we launch the stateful materialization bit, we will have a complete system for building end to end streaming data flows.

Re: Iggy.rs – building message streaming in Rust

#57
post #20
post #4

Would love to give it a go at some point (but I'll first need to learn Rust). On a side note, I love the aesthetic of the site.

Exactly, we have multiple SDKs, and the blog uses Rust Zola engine :)

I'm still trying to learn Zola well. Do you plan to open-source the website?

Re: Iggy.rs – building message streaming in Rust

#58
post #20

Earlier quoted context omitted.

Exactly, we have multiple SDKs, and the blog uses Rust Zola engine :)

I'm still trying to learn Zola well. Do you plan to open-source the website?

If you're talking about the blog, it's an open source Zola theme https://github.com/not-matthias/apollo (the original site https://secret.club which it's based on/inspired by is closed source though)

Re: Iggy.rs – building message streaming in Rust

#59
post #43

Built something similar in Go with a friend a few years ago. https://github.com/thibauts/styx

Nice one, looks quite similar indeed! May I ask why did you discontinue the further work?

Lack of traction basically. We ran out of time and money. Also we, maybe wrongly, did not feel like we could compete with the big ones without clustering. Yet we had a lot of fun building it. It was a thrill to see our product deliver performance on par or above in-memory messaging systems while being fully persisted and fsync’ed. I’m sure you know what I mean ! Good luck with Iggy anyway. Looks like you are on the right track !

Re: Iggy.rs – building message streaming in Rust

#60

Earlier quoted context omitted.

I'm still trying to learn Zola well. Do you plan to open-source the website?

If you're talking about the blog, it's an open source Zola theme https://github.com/not-matthias/apollo (the original site https://secret.club which it's based on/inspired by is closed source though)

No, I really need to see how did he structure his website exactly -- to learn how I would do it as well.

I'll take a look at the theme as well, thank you.

Post reply on HN