Viewing profile — relay23

or kafka, or any other publish/subscribe system

Sounds about right.

Kafka doesn't guarantee exactly once delivery at all, unless you're using Kafka Streams and even then your final output topic still won't get exactly once, the consumer group proto…

It's cheaper until you get to a sizeable workload, and the P90+ latency is ridiculous.. the kafka api is weak and when you're not using kafka api you're limited on integration tool…

There is Redis Streams, but certainly not without it's problems. Super obscure, not a lot of client support.

Massive and complex platform.. at a certain point why not just run 2 different platforms that are best of breed for each.

>> Rabbit can do everything Kafka does - and much more - in a more configurable manner. Sure, if you're doing like 10's of MB/s. RMQ is fast compared to AK if you're not adding dur…

They always have.. you get it but you don't know it.

Maybe "it's enterprise" means that's what the enterprise standardized on. There are a couple of practical reasons that come to mind on why that's the case - a) it's more resilient …

Also https://jepsen.io/analyses/redpanda-21.10.1

Are you sure performance would be acceptable if you just turned on fsync on every message?

Almost nobody auto commits offsets in real applications though. If you do then you should really stop :)