Live data from Hacker News

Looking At The World Through Twitter Data

arashd.scripts.mit.edu

21–27 of 27 posts

Re: Looking At The World Through Twitter Data

#23

But, this is because non-English tweets that we have discarded are much more frequent during the night in our time zone, and they often don’t contain the word ‘a’ as often as English tweets do. This doesn't make sense; are they only discarding the non-English tweets during certains times?

We just mean that there's more tweeting going on in non-English speaking countries when it's night-time here.

Why don't you offer an option to normalize against the number of English-speaking tweets (or any other language you can pick out) over a given hour. You could build your own classifier or use something like Apache Tika. Regardless, really really nice work. The graph is beautiful and highly functional. Did you guys write the graph lib yourselves?

Re: Looking At The World Through Twitter Data

#24
post #21

Interesting data. I would be curious to find out how the general sentiment correlates with consumer behavior, e.g., financial market swings, purchases on amazon.com, google searches, etc.

Twitter Mood Predicts the Stock Market http://www.sciencedirect.com/science/article/pii/S1877750311... (and also in the arXiv http://arxiv.org/abs/1010.3003 )

Re: Looking At The World Through Twitter Data

#25

A friend and I started playing around with twitter data back in early 2010. We currently have something close to over 587 million tweets collected (We stopped collecting earlier this year). We only pulled English tweets and those that described what someone was feeling (Im, I am, I feel, I am feeling, etc. along with the negatives I don't feel, I do not feel, etc). We were able to see some interesting events happen d…

That type of daily behavior is common in human activities. It matches nicely with typical daily activities like waking up, having lunch, etc... See http://www.bgoncalves.com/component/jdownloads/finish/3/17.h... for an example in web page traffic, http://www.barabasilab.com/pubs/CCNR-ALB_Publications/200805... for cell phone traffic, etc...

Re: Looking At The World Through Twitter Data

#26
post #2

If you're interested in how information diffuses through social networks like Twitter, take a look at Truthy (one of my projects): http://truthy.indiana.edu Truthy is a system to analyze and visualize the diffusion of information on Twitter. The Truthy system evaluates thousands of tweets an hour to identify new and emerging bursts of activity around memes of various flavors. The data and statistics provided by Truth…

sounds like a cool thing to tackle. We'll definitely look at it!

Great. Let me know if you have any questions or suggestions. I'm nearby at Northeastern.
Post reply on HN