DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second

Post by quipo » Wed, Nov 30, 2011, 4:22 AM UTC

geuis wrote: post #5

I find the architecture to be really interesting and useful to learn from. However, they are way too expensive. 1000 tweets is not very much data. I'm building a realtime app now and easily am processing tens of thousands of relevant tweets a day. While a service like Datasift could alleviate a lot of heavy lifting on my part, the cost just doesn't make up for it. It feels like their business model is currently focus…

@geuis: the cost for 1000 tweets is $0.10, and that's the Twitter license fee. You get $10 in free credits when you sign up, and you can have an On Demand plan starting from $10. It should definitely make it very affordable to anyone wanting to play with the Twitter firehose, the barrier-to-entry has never been so low.

Post by kalkat » Wed, Nov 30, 2011, 8:05 PM UTC

djb_hackernews wrote: post #7

Excellent article. I worked on a project that I integrated with DataSift. Lorenzo and every one else I emailed with were very quick to respond and the product performed as expected (besides some hiccups that I can easily understand due to growing pains). Compared to Gnip, (which we also integrated with) DataSift won hands down on both quality of product and customer relations. However, I'm still suspect of the useful…

There is a lot of value in mining data off social media, but only if you can convert that into simple and easy use cases. We are doing something like that, and we are very happy about the way it is shaping up.

Re: DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second

Re: DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second