Amazon MSK – managed streaming for Apache Kafka – now generally available • Hacker News Board

Amazon MSK – managed streaming for Apache Kafka – now generally available

#1

Post by markusbk » Fri, May 31, 2019, 4:16 AM UTC

Amazon MSK – managed streaming for Apache Kafka – now generally available
aws.amazon.com

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#2

Post by pul » Fri, May 31, 2019, 6:00 AM UTC

Introduced just weeks after Confluent introduced their similar service [1]. Has anyone done an in depth comparison yet?

[1] https://www.confluent.io/confluent-cloud/

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#3

Post by polskibus » Fri, May 31, 2019, 6:27 AM UTC

pul wrote: post #2

Introduced just weeks after Confluent introduced their similar service [1]. Has anyone done an in depth comparison yet? [1] https://www.confluent.io/confluent-cloud/

Does this mean that confluent will soon close the license in front of the public cloud providers?

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#4

Post by buremba » Fri, May 31, 2019, 6:45 AM UTC

I wonder how it differs from the managed Kafka of Confluent since they also support AWS as the backend. It sounds like the same story of Elasticsearch, MongoDB and Redis though.

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#5

Post by manigandham » Fri, May 31, 2019, 6:48 AM UTC

pul wrote: post #2

Introduced just weeks after Confluent introduced their similar service [1]. Has anyone done an in depth comparison yet? [1] https://www.confluent.io/confluent-cloud/

Confluent has had a cloud offering for years now but made the self-serve options more available. Now the basic tier pricing has been changed to only be billed on data transferred instead of provisioned throughput. Kafka is the same between both services but Confluent provides extra like KSQL, Schema Registry and some of their other tools.

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#6

Post by votepaunchy » Fri, May 31, 2019, 9:23 AM UTC

polskibus wrote: post #3

pul wrote: post #2

Introduced just weeks after Confluent introduced their similar service [1]. Has anyone done an in depth comparison yet? [1] https://www.confluent.io/confluent-cloud/

Does this mean that confluent will soon close the license in front of the public cloud providers?

It isn’t as easy to do this for Kafka. Not only do they use the Apache License, as an Apache project they would need to completely change their governance. The ASF also owns the Apache trademark so Confluent would need to completely rebrand.

https://tsdr.uspto.gov/#caseNumber=5213501

Re: Amazon MSK – managed streaming for Apache Kafka – now generally available

#7

Post by z9e » Fri, May 31, 2019, 12:41 PM UTC

pul wrote: post #2

Introduced just weeks after Confluent introduced their similar service [1]. Has anyone done an in depth comparison yet? [1] https://www.confluent.io/confluent-cloud/

https://medium.com/@stephane.maarek/an-honest-review-of-aws-..., though this is mainly written pre-GA so I'm not sure how accurate it is now.

I've recently gotten quotes from Confluent Cloud after doing some pricing on AWS for our setup, and they are far more expensive than MSK, but you do get more bells and whistles. It's more cost-effective for us to run our own, which also gives us more flexibility when it comes to monitoring and alerting around the environment.