Viewing profile — XPherior

One of the authors here. The neat thing about this set up is that these streaming examples are executing against a real stream processor in the browser. The interactive examples we…

Distributed Masonry uses Clojure to build Onyx [1], an open source distributed batch and streaming platform. We also build a realtime application platform named Pyroclast [2] direc…

We persist the IDs to disk with RocksDB itself when that happens, periodically pruning them away when the messages are complete. The Bloom filter is mostly an optimization - even t…

Performance - wait until the 0.6.0 release. We'll be caught up with Storm by then. The tree model is being removed in 0.6.0 in favor of a vector of vectors (DAG), which allows mult…

I wasn't aware that they're Thrift serializable - that's cool, and offers roughly what Onyx does in terms of its workflow representation. Onyx goes a little further though in terms…

- Picking up Kafka means introducing another dependency. - Onyx's log doesn't grow particularly large because it's only used for coordination, not for messaging. - Because the log …

I'll paraphrase a few snippets from my own documentation to answer these questions. Happy to comment more if needed. Information models are often superior to APIs, and almost alway…

See: https://github.com/MichaelDrogalis/onyx/blob/0.5.x/doc/user-... These are all the things I wrote down that I wanted before I wrote the first line of code.

Hi folks! I'm Michael Drogalis - the primary author. I'm happy to answer any questions.

Hello, Michael Drogalis - the author here. I'm also not a Spark user, but I have used Storm: - Storm is significantly more mature and performant the moment. - Storm has a better cr…