51–60 of 62 posts
This seems conceptually similar to http://www.cascading.org/ (at least looking the code examples: http://www.cascading.org/1.1/userguide/html/ch02.html ).
Stream processing jobs can be massaged to fit into the MapReduce paradigm, but S4 provides a more natural solution.
Earlier quoted context omitted.
My attempt at a more friendly description of S4 (based on my very limited understanding of it - please correct me if I'm wrong): When processing large amounts of streaming data, you have to process the data as fast as it comes in or else you can't keep up. You probably wonder: "Why not simply delay the processing of new data while the old data is being processed?". The problem lies in the fact we're dealing with a st…
Good, except stream processing does not imply that there needs to be a master node - it can truly be distributed. I don't know if S4 is set up like this, though.
S4 is a general-purpose, distributed, scalable, partially fault-tolerant, pluggable platform that allows programmers to easily develop applications for processing continuous unbounded streams of data. I'm sure this is cool and useful technology. At this moment, from the marketing-speak, I have no idea what it does except that it has something to do with volumes of streaming data. Whose data? Is it a service? (Maybe n…
Up voted the story just so more people read your comment. This kind of "marketing-speak" focused on technical details is well too widespread. The project may be technical by nature but there's got to be a higher level way of describing it.
Earlier quoted context omitted.
Up voted the story just so more people read your comment. This kind of "marketing-speak" focused on technical details is well too widespread. The project may be technical by nature but there's got to be a higher level way of describing it.
It's frustrating, isn't it? S4 sounds like it does something cool and useful, and I'd like to know what this is, just for reference at least. But I don't have time to go and figure it out on my own; I'm too busy trying to stay productive.
website sure looks a lot like http://mootools.net
In the twitter demo, I noticed this pathological looking string concat statement https://github.com/s4/examples/blob/master/twittertopiccount... Im too dim to figure out why it would be done this way (besides the fact thats its an early proof of concept demo). Any idea?
S4 is a general-purpose, distributed, scalable, partially fault-tolerant, pluggable platform that allows programmers to easily develop applications for processing continuous unbounded streams of data. I'm sure this is cool and useful technology. At this moment, from the marketing-speak, I have no idea what it does except that it has something to do with volumes of streaming data. Whose data? Is it a service? (Maybe n…
Up voted the story just so more people read your comment. This kind of "marketing-speak" focused on technical details is well too widespread. The project may be technical by nature but there's got to be a higher level way of describing it.
If the terms used are not clear to someone reading it, they are probably not the right person to implement a good distributed system anyway.
Earlier quoted context omitted.
it's opensource, anyone could do that, not just Yahoo!
Are you confusing open source with a wiki editable by everyone? Open source just means that you can fork it and do whatever you want with your own version, e.g. fix it. The original owner's don't have to accept your fix.