Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Building WebSocket in Apache Iggy with Io_uring and Completion Based IO

iggy.apache.org

Post reply on HN
Print view View original

1–7 of 7 posts

Re: Show HN: Building WebSocket in Apache Iggy with Io_uring and Completion Based IO

#2

Post by swiftcoder »

Having worked on a number of message brokers, but not really fucked with append-only log streams, what's the actually selling point here?

Feels like the simplicity wins are made by only solving one half of the problem space (only writes), and it introduces new problems of its own (like how do we truncate the append-only log once readers are done with it?)

Re: Show HN: Building WebSocket in Apache Iggy with Io_uring and Completion Based IO

#3

Post by jauntywundrkind »

Fun write-up. Good stuff, very nice contribution to to compio of compio-ws. Looks like the Iggy switched to thread-per-core compio back in July. https://github.com/apache/iggy/pull/1960

One thing I saw mentioned in the 0.5.0 release notes (which happened shortly after migrating to compio): trying to switch to a Sans-IO model design (but maybe just for clients?). It feels like there's similar ownership concerns that might arise, as seen here with the poll-vs-completion challenges faced here. A lot of good learnings to be had, as we go forth to faster better io, eager to keep tuning in & hearing more. Thanks for the write up! https://iggy.apache.org/blogs/2025/08/10/release-0.5.0/#what... https://www.firezone.dev/blog/sans-io

Re: Show HN: Building WebSocket in Apache Iggy with Io_uring and Completion Based IO

#4

Post by spetz »

swiftcoder wrote: post #2

Having worked on a number of message brokers, but not really fucked with append-only log streams, what's the actually selling point here? Feels like the simplicity wins are made by only solving one half of the problem space (only writes), and it introduces new problems of its own (like how do we truncate the append-only log once readers are done with it?)

There's a core difference between the message queue and the stream, and one of them is that the append-only log acts as a simple database from which multiple independent consumers can read records at the same time; hence, you don't truncate the append-only log unless specified in its settings via a particular cleanup policy (e.g. based on message expiry or its allowed size).

Re: Show HN: Building WebSocket in Apache Iggy with Io_uring and Completion Based IO

#5

Post by spetz »

jauntywundrkind wrote: post #3

Fun write-up. Good stuff, very nice contribution to to compio of compio-ws. Looks like the Iggy switched to thread-per-core compio back in July. https://github.com/apache/iggy/pull/1960 One thing I saw mentioned in the 0.5.0 release notes (which happened shortly after migrating to compio): trying to switch to a Sans-IO model design (but maybe just for clients?). It feels like there's similar ownership concerns that m…

Thanks! Actually, the mentioned PR was just an internal merge; the one to the master branch is this one https://github.com/apache/iggy/pull/2299 which happened last week :)

Sans-IO is for clients only, and we'd like to introduce it one day to SDK to support the different runtimes as well as the blocking, sync client.

Post reply on HN