Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kafka without ZooKeeper

confluent.io

Post reply on HN
Print view View original

21–30 of 201 posts

Re: Kafka without ZooKeeper

#21

Post by toomanybits »

haolez wrote: post #2

Kafka is a pretty cool technology, but for every project that I work on, it's never used because it feels like it's overkill (costly and operation heavy). Maybe I should start looking for bigger projects :D

I think that's one of the main points. Now you can run it as a single process more like a traditional broker (although it's obviously still a log).

Re: Kafka without ZooKeeper

#23

Post by simplecto »

cmckn wrote: post #8

Oh hell yeah! That's great news, tons of work went into this -- props to the contributors! I will take the opportunity to say that Kafka is kind of painful, with or without ZK. Check out NATS! [0]. It doesn't solve all the same problems, but is so much easier to use (during development especially) and can do a lot of the same things. [0]: https://docs.nats.io/whats_new_20

Using Kafka only for ordered pub-sub is like ordering tap water at French Laundry.

Re: Kafka without ZooKeeper

#24

Post by yes_but_no »

cmckn wrote: post #8

Oh hell yeah! That's great news, tons of work went into this -- props to the contributors! I will take the opportunity to say that Kafka is kind of painful, with or without ZK. Check out NATS! [0]. It doesn't solve all the same problems, but is so much easier to use (during development especially) and can do a lot of the same things. [0]: https://docs.nats.io/whats_new_20

I believe NATS Streaming[0] and upcoming Nats Jetstream[1] could be more relevant to those who looking for a Kafka alternative. They offer persistent messages, at-least-once delivery similar to Kafka.

[0] https://docs.nats.io/nats-streaming-concepts/intro [1] https://github.com/nats-io/jetstream

Re: Kafka without ZooKeeper

#25

Post by AdmiralAsshat »

jaytaylor wrote: post #13
autophagian wrote: post #4

One immediate downside to this: it is now likely that fewer and fewer people will be exposed to the absolutely excellent Zookeeper logo.

See: https://en.wikipedia.org/wiki/Apache_ZooKeeper https://upload.wikimedia.org/wikipedia/en/thumb/8/81/Apache_...

Those are some impressively sized hands.

Re: Kafka without ZooKeeper

#26

Post by unixhero »

math wrote: post #18
haolez wrote: post #2

Kafka is a pretty cool technology, but for every project that I work on, it's never used because it feels like it's overkill (costly and operation heavy). Maybe I should start looking for bigger projects :D

You can tune Kafka down fairly well if you know what you're doing, but it's not optimised for that OOTB. Or just use Confluent Cloud, which is fully managed and scales down as low as you want (costs cents per Gb). Disclosure: work for Confluent.

Thank you for disclosing and not disclaiming.

Re: Kafka without ZooKeeper

#27

Post by bruth »

cmckn wrote: post #8

Oh hell yeah! That's great news, tons of work went into this -- props to the contributors! I will take the opportunity to say that Kafka is kind of painful, with or without ZK. Check out NATS! [0]. It doesn't solve all the same problems, but is so much easier to use (during development especially) and can do a lot of the same things. [0]: https://docs.nats.io/whats_new_20

There was a more recent 2.2 release with durable streams [0]. There is also a comparison page including Kafka [1].

[0]: https://docs.nats.io/whats_new_22 [1]: https://docs.nats.io/compare-nats

Re: Kafka without ZooKeeper

#30

Post by temuze »

AdmiralAsshat wrote: post #25
jaytaylor wrote: post #13

Earlier quoted context omitted.

See: https://en.wikipedia.org/wiki/Apache_ZooKeeper https://upload.wikimedia.org/wikipedia/en/thumb/8/81/Apache_...

Those are some impressively sized hands.

This is the ideal open source logo. You may not like it, but this is what peak performance looks like.
Post reply on HN