Streamparse: Pythonic processing of real-time data streams using Apache Storm

#1

Post by msukmanowsky » Sun, May 11, 2014, 3:10 PM UTC

Launch announcement: http://www.pixelmonkey.org/2014/05/04/streamparse?utm_medium=referral&utm_source=news.ycombinator.com

Streamparse: Pythonic processing of real-time data streams using Apache Storm
github.com

Re: Streamparse: Pythonic processing of real-time data streams using Apache Storm

#2

Post by zobzu » Sun, May 11, 2014, 6:24 PM UTC

dat java

Re: Streamparse: Pythonic processing of real-time data streams using Apache Storm

#3

Post by dang » Sun, May 11, 2014, 6:44 PM UTC

The submitter included a link to a launch announcement, but the text field doesn't get posted when there's a url. Here's the link: http://www.pixelmonkey.org/2014/05/04/streamparse

Re: Streamparse: Pythonic processing of real-time data streams using Apache Storm

#4

Post by dmritard96 » Sun, May 11, 2014, 7:56 PM UTC

so i know storm already supported python bolts/spouts. I'm sure there is value added here but I would love an explanation/example of why this is better than simply implementing my topology on top of storm by it self.

Re: Streamparse: Pythonic processing of real-time data streams using Apache Storm

#5

Post by pixelmonkey » Sun, May 11, 2014, 8:13 PM UTC

dmritard96 wrote: post #4

so i know storm already supported python bolts/spouts. I'm sure there is value added here but I would love an explanation/example of why this is better than simply implementing my topology on top of storm by it self.

streamparse does run Python bolts and spouts atop Storm itself. The difference is that it is an improved Python multilang adapter. It also has command-line tooling for making projects and submitting topologies to a Storm cluster.