I was interested until I saw the Zookeeper dependency. I have had too many deployment nightmares with Zookeeper. I would prefer to avoid it as much as possible, plus systems software in Java, sigh.
'plus systems software in Java', mind sharing an explanation?
Twitter open-sources a high-performance replicated log service
51–60 of 121 posts
Re: Twitter open-sources a high-performance replicated log service
#52Re: Twitter open-sources a high-performance replicated log service
#53This could be an interesting competitor to Apache Kafka, which is singularly unique in this space as far as I'm aware. On another note, I find it somewhat funny that these are called "log" services, logging is probably the least interesting use case for these things I can think of. A better description in my mind would be as a distributed event processing framework, since what they are really doing is distributing di…
I'm pretty sure that this post inspired DL. It was written by Jay, one of the 3 founders of kafka (Jay, Jun, and Neha) and should be recommended reading for every software engineer if you've not read it: https://engineering.linkedin.com/distributed-systems/log-wha... An ordered append only datastructure is rightfully called a log. The fact that text based files are called logs is just an annoying feature in common en…
Re: Twitter open-sources a high-performance replicated log service
#54I was interested until I saw the Zookeeper dependency. I have had too many deployment nightmares with Zookeeper. I would prefer to avoid it as much as possible, plus systems software in Java, sigh.
Would also be interested to hear more about the "deployment nightmares with Zookeeper". For us, it has to be one of the most stable pieces of 3rd party server software we run.
Lots of things can and do go wrong with Zookeeper. I suspect it depends on the use case, but building a Zookeeper dependency into any system is potentially asking a lot of users/operators.
Re: Twitter open-sources a high-performance replicated log service
#55Cassandra doesn't work, and Hadoop is a complete waste of hosts for most companies (hence the move to Spark.)
Re: Twitter open-sources a high-performance replicated log service
#56No, actually Java is a bane to the database world. Cassandra doesn't work, and Hadoop is a complete waste of hosts for most companies (hence the move to Spark.)
...which also runs on the Java Virtual Machine and is subject to the same pros and cons.
Re: Twitter open-sources a high-performance replicated log service
#57Re: Twitter open-sources a high-performance replicated log service
#58No, actually Java is a bane to the database world. Cassandra doesn't work, and Hadoop is a complete waste of hosts for most companies (hence the move to Spark.)
Re: Twitter open-sources a high-performance replicated log service
#59No, actually Java is a bane to the database world. Cassandra doesn't work, and Hadoop is a complete waste of hosts for most companies (hence the move to Spark.)
> hence the move to Spark ...which also runs on the Java Virtual Machine and is subject to the same pros and cons.
Re: Twitter open-sources a high-performance replicated log service
#60Earlier quoted context omitted.
'plus systems software in Java', mind sharing an explanation?
Java has garbage collection and is about two times slower than C
On the other hand, as a mortal, I can write a-grade-above-code-that-an-idiot-would-write-just code in Java at about 10 times the speed I can write dire-useless-risible C code.
The comparison is pointless though, good modern languages like Rust and Julia are developing and LLVM is enabling further development.