Live data from Hacker News

Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

github.com

1–10 of 30 posts

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#2
They're making a lot of claims and in the readme present zero measurements. The official Kafka distro is pretty bulletproof since 7+ years ago. It'd be great if they could include more information for the (apparently). initiated!

I am open to new things.. with at least a tad of supporting data attached :D Ymmv.

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#4
post #2

They're making a lot of claims and in the readme present zero measurements. The official Kafka distro is pretty bulletproof since 7+ years ago. It'd be great if they could include more information for the (apparently). initiated! I am open to new things.. with at least a tad of supporting data attached :D Ymmv.

[deleted]

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#5
The Kafka API and S3 API have each become the de facto standard in the stream processing and object storage domains, respectively. Compared to other Kafka solutions, AutoMQ has embraced them more effectively. I believe AutoMQ has a long way to go.

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#6
Be interesting to see how well they do.

Most of the Kafka deployments I've seen in recent years have been using cloud versions e.g. AWS Managed Kafka.

So it's great that you save money on compute but it does mean you are now operating it yourself which then costs money.

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#7

Seems nice, but are there any publicly available documentation to be able to evaluate its readiness and what languages are there libraries for? I may be blind but I cannot find any.

If you need to ask you aren't ready for something like this.

That said, it's basically Kafka with the topic-partition persistence swapped out. So the libraries etc are just the standard Kafka libraries because the frontend listener is unmodified.

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#8

The Kafka API and S3 API have each become the de facto standard in the stream processing and object storage domains, respectively. Compared to other Kafka solutions, AutoMQ has embraced them more effectively. I believe AutoMQ has a long way to go.

It's a bit unfortunate IMO because Kafka while perfectly adequate for streaming often winds up with someone wanting to use it like a work queue which predictably ends horribly.

Ideally something like Pulsars API (which more resembles something like GCP Pub/Sub) would be the de facto as it is capable of handling both cases seamlessly.

There was Kafka-on-Pulsar until recently until the developers essentially made it non-OSS which is pretty unfortunate for Pulsar adoption which is already low.

Re: Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds

#10
post #8

The Kafka API and S3 API have each become the de facto standard in the stream processing and object storage domains, respectively. Compared to other Kafka solutions, AutoMQ has embraced them more effectively. I believe AutoMQ has a long way to go.

It's a bit unfortunate IMO because Kafka while perfectly adequate for streaming often winds up with someone wanting to use it like a work queue which predictably ends horribly. Ideally something like Pulsars API (which more resembles something like GCP Pub/Sub) would be the de facto as it is capable of handling both cases seamlessly. There was Kafka-on-Pulsar until recently until the developers essentially made it no…

[deleted]
Post reply on HN