Live data from Hacker News

Twitter improves API usage for researchers

blog.twitter.com

11–20 of 49 posts

Re: Twitter improves API usage for researchers

#11
post #8

I always wondered: how many of these tweets are just Justin Bieber fandom type posts, bots, spam, or other dross? Twitter is infamous for its bad signal to noise ratio. These researchers need to write algos to filter out all the noise

Are there researchers out there using bot accounts to prospectively experiment with social media researchers?

Re: Twitter improves API usage for researchers

#12
post #9

basing on those UI screens, then why research is always associated with academia? there's a lot of strong people especially in CS who do not work with academia and still work on interesting stuff

Absolutely. The limitation to people associated with academic institutions is pretty old fashioned (and also, from another point of view, modern).

Re: Twitter improves API usage for researchers

#13
post #9

basing on those UI screens, then why research is always associated with academia? there's a lot of strong people especially in CS who do not work with academia and still work on interesting stuff

Maybe it has to do with control. Student==likely low impact. Faculty==likely uncontroversial. API==looks like transparency.

Re: Twitter improves API usage for researchers

#14
post #8

I always wondered: how many of these tweets are just Justin Bieber fandom type posts, bots, spam, or other dross? Twitter is infamous for its bad signal to noise ratio. These researchers need to write algos to filter out all the noise

What's wrong with that? If you wanted to investigate, say, the rise of The Beatles - wouldn't you love to have access to the random thoughts of their fans in the 1960s?

Similarly, if you're researching bots and spam and how they manipulate people & markets - this is still useful.

Re: Twitter improves API usage for researchers

#15
post #3

Could have saved you some work, the research results are that Twitter is very liberal, less conservative and nobody has seen a libertarian for days.

I'd think libertarians would love twitter, deplatforming is the free market at work and the government has no right to make them do business with anyone they choose not to

And one might think liberals, putting liberty above order, would be aghast at silencing opponents to maintain order, and yet here we are. Our political theater has gotten pretty weird. The whole thing is looking more and more like unprincipled tribes vying for power.

Re: Twitter improves API usage for researchers

#16
post #10

In what research contexts is API usage valid instead of scraping a view more similar to what people experience? If the Twitter site and API are retrospectively cleared of removed/suspended accounts with large impact, how does that affect retrospective studies? Are there ethical implications of working with Twitter to gather data? Despite Twitter TOS, legal, IRB ok, are there informed consent issues in studying the ar…

One easy example is language, for example tracking the spread of new words or other language constructs. You don’t care how the site looks, you care about the text that was previously input.

Re: Twitter improves API usage for researchers

#17
post #15

Earlier quoted context omitted.

I'd think libertarians would love twitter, deplatforming is the free market at work and the government has no right to make them do business with anyone they choose not to

And one might think liberals, putting liberty above order, would be aghast at silencing opponents to maintain order, and yet here we are. Our political theater has gotten pretty weird. The whole thing is looking more and more like unprincipled tribes vying for power.

Silence is a strong word -- I'm certainly still able to hear news from Donald Trump, even if he was banned from Twitter.

Re: Twitter improves API usage for researchers

#18
post #10

In what research contexts is API usage valid instead of scraping a view more similar to what people experience? If the Twitter site and API are retrospectively cleared of removed/suspended accounts with large impact, how does that affect retrospective studies? Are there ethical implications of working with Twitter to gather data? Despite Twitter TOS, legal, IRB ok, are there informed consent issues in studying the ar…

Until now, none I think. The API only gave a partial view while scraping offered all tweets for a particular search term. The scraper had to be clever to juke the anti scraping systems but you would get a more complete data set than using the API.

And the streaming API was terrible. Even if there was no data on the stream you could consume tens of gigabytes of bandwidth a day. Dreadful.

Re: Twitter improves API usage for researchers

#19
post #15

Earlier quoted context omitted.

And one might think liberals, putting liberty above order, would be aghast at silencing opponents to maintain order, and yet here we are. Our political theater has gotten pretty weird. The whole thing is looking more and more like unprincipled tribes vying for power.

Silence is a strong word -- I'm certainly still able to hear news from Donald Trump, even if he was banned from Twitter.

You're right about Trump. Most people don't have the platform he has.

Many dissenting voices have been removed from the conversation, and you wouldn't even know they are missing.

Re: Twitter improves API usage for researchers

#20
I wonder how are they going to enforce their rules, e.g. non-commercial use. I assume this will require some monitoring to be effective. Large scale Twitter API access is typically pricey, malicious actors might try to buy or steal researcher's credentials to cut costs.
Post reply on HN