Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

london.feels.website

Post reply on HN
Print view View original

21–30 of 39 posts

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#21

Post by MrMattWright »

robin_reala wrote: post #13
aw3c2 wrote: post #3

Clicked through ~20 of them and the analysis was completely off in most cases.

Yep, although in some cases understandably. One tweet listed as ‘Not good’ had the text ‘Killed it! 🔫’ and a location given as a comedy club. I’m assuming someone had had a good gig, but I’m not surprised a classifier algorithm got that wrong.

Sentiment.js (which is what we used in devwax and I am guessing the same here) is just AFINN based Sentiment.https://www.npmjs.org/package/sentiment which you can customize. So in our case we added things like {"barreling": 2} etc. What would be better is a bigram/trigram based approach do you could score "Going Off" and "Killed It" etc, but I am not sure if there is a js library that does that?

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#22

Post by chippy »

radiodario wrote: post #11
MrMattWright wrote: post #10

Cool! Hey, that's very funny.... We did the same with Tweets and Surfing. http://devwax.herokuapp.com/ from the meetup: http://www.meetup.com/DevWax/ . It was all done in a weekend with some drinking and surfing, so it's a bit rough. The trouble with surfing was that the locations are very disparate and hard to guess. Fun to have a go at though... Are you in London? (We are)

hey sweet orthographic projection! Yeah, i'm in London. I'm only using tweets on which users chose to publish their locaiton, so it isn't all of the tweets, but a good chunk of them.

Given that most people tweet close to home, that most people work close to home, you can get the home location of the user from their profile, and geocode it to assign a location to the tweet.

This approach only works when aggregating tweets for a larger area. E.g. comparing 10,000 tweets each in UK county, or perhaps for cities.

For even larger areas (think regions / countries) you could look through the user bios, or previous tweets to pull out any names or locations and do some analysis to work out which broader region they are in.

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#23

Post by MrMattWright »

radiodario wrote: post #11
MrMattWright wrote: post #10

Cool! Hey, that's very funny.... We did the same with Tweets and Surfing. http://devwax.herokuapp.com/ from the meetup: http://www.meetup.com/DevWax/ . It was all done in a weekend with some drinking and surfing, so it's a bit rough. The trouble with surfing was that the locations are very disparate and hard to guess. Fun to have a go at though... Are you in London? (We are)

hey sweet orthographic projection! Yeah, i'm in London. I'm only using tweets on which users chose to publish their locaiton, so it isn't all of the tweets, but a good chunk of them.

Cool, we are in Southwark, doing a bunch of graph visualisation stuff (http://blog.stitched.io/), so come by for a beer at some point, would be good to chat.

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#25

Post by radiodario »

jwblackwell wrote: post #24

Cool idea. Unfortunately I've yet to see sentiment analysis even really come close to providing any useful insights. It's just not accurate enough on 140 character tweets.

yep you're right - this is just a cool toy to have a look at what Londoners are up to - the focus isn't scientific, more like "hey what are all those people there tweeting about".

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#26

Post by ripb »

Nice site, although it does have issues with the analysis as outlined by others here.

One suggestion I would have is some sort of filtering based on the content of the tweets. This tweet returned "feeling good":

"New post featuring: @NewLookPRTeam @nextofficial @Matalan @hmunitedkingdom @uoeurope @Accessorize @ASOS http://t.co/nGsFj306xT #fbloggers"

This one returned "feeling average":

"@dannykobe17 @DanielRacheter @Khuds_ @shangambling @Umar_Wilshere19 @_mikenewell_ @BlueKay10 is that ollie?"

Whereas there's absolutely no real sentiment to derive from this sort of thing.

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#27

Post by ripb »

jwblackwell wrote: post #24

Cool idea. Unfortunately I've yet to see sentiment analysis even really come close to providing any useful insights. It's just not accurate enough on 140 character tweets.

>It's just not accurate enough on 140 character tweets.

I would disagree but apply the caveat that there has to be heavy filtering of what is being analysed to derive anything of value from it.

A tweet like:

"“@BarkhamTaylor: #beatcameronathisowngame @aliceehoughton” let's get it trending #adrian"

Has no value for sentiment analysis, yet is lumped in with the rest of them, while something like:

"Sunny day in London :) @ Green Park http://t.co/S71RQR2luU"

Clearly has value regarding sentiment analysis. The current problem being that all of the junk gets marked as "average" or similar because sentiment can't be derived from it, which in the overall set skews things greatly.

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#28

Post by cal2 »

radiodario wrote: post #14
cal2 wrote: post #12

Earlier quoted context omitted.

I personally feel like the colors shouldn't affect color blind individuals (e.g. light blue and orange). But great job overall!

Hey thanks for the feedback, I'll change the "bad" colour to orange - should be easy enough to do!

Very cool, thanks!

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#29

Post by kriro »

Very cool but before clicking on some dots I was wondering why everyone feels the same. The colors are not ideal for red/green colorblind people (is it blue and purple?)

Maybe include a feature to select the colors for happy/sad/average with a button to return to defaults?

Black for sad, light grey for neutral, something like a medium bright green for happy would be my picks.

Re: Show HN: London Feels – Sentiment-analysis of Londoners Tweets on a Map

#30

Post by radiodario »

kriro wrote: post #29

Very cool but before clicking on some dots I was wondering why everyone feels the same. The colors are not ideal for red/green colorblind people (is it blue and purple?) Maybe include a feature to select the colors for happy/sad/average with a button to return to defaults? Black for sad, light grey for neutral, something like a medium bright green for happy would be my picks.

cool idea - i tried to pick perceptually separate colours and thought blue and red would work, but turns it's confusing for some people. I might add "colorblind" mode and use your colour range.
Post reply on HN