Live data from Hacker News

Ask HN: To everybody who uses MapReduce: what problems do you solve?

news.ycombinator.com

121–122 of 122 posts

Re: Ask HN: To everybody who uses MapReduce: what problems do you solve?

#121
post #111

While the push-back against Map/Reduce & "Big Data" in general is totally valid, it's important to put it into context. In 2007-2010, when Hadoop first started to gain momentum it was very useful because disk sizes were smaller, 64 bit machines weren't ubiquitous and (perhaps most importantly) SSDs were insanely expensive for anything more than tiny amounts of data. That meant if you had more than a couple of terabyt…

It still is a valid pattern. As disks get bigger, the harder it is to move the data and the more efficient it is to move the compute to the data.

Re: Ask HN: To everybody who uses MapReduce: what problems do you solve?

#122
post #17

I was using it on a D3.JS chart to aggregate data flow though our custom real-time analytic pipeline.

Will u mind sharing some more info on this real time analytics using d3 as i am also planning to do something like tht..

look up crossfilter.js
Post reply on HN