Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

271–280 of 1001 posts

Re: Twitter's Recommendation Algorithm

#271
post #236

I wonder what the "author_is_elon", "author_is_power_user", "author_is_democrat", and "author_is_republican" labels are for [1]. [1]: https://github.com/twitter/the-algorithm/blob/main/home-mixe...

Elon is addressing this in the Twitter Space right now. "It definitely shouldn't be dividing people into Republican and Democrats; that makes no sense[...] you've identified something we should be getting rid of right away."

We should also not divide people into Elon and non-Elon.

Re: Twitter's Recommendation Algorithm

#272

"Today, the For You timeline consists of 50% In-Network Tweets and 50% Out-of-Network Tweets on average, though this may vary from user to user." I have spent significant effort creating a network and there you go choosing to ignore my efforts by putting in 50% of crap-I-don't-want-to-see. That is why I despise your algorithm.

> "Today, the For You timeline consists of 50% In-Network Tweets and 50% Out-of-Network Tweets on average, though this may vary from user to user." I have spent significant effort creating a network and there you go choosing to ignore my efforts by putting in 50% of crap-I-don't-want-to-see. That is why I despise your algorithm. This is just one feed (the "For You" recommendations feed), they also have the "following…

I'm not on twitter enough for the chronological feed to be appealing to me, and instead want to see the notable tweets from the accounts I follow since the time I last visited. There's no straightforward way to achieve this, but if anyone else has this preference, the workaround is to create a twitter list with all the accounts you follow and set it to show top tweets first.

Re: Twitter's Recommendation Algorithm

#273
post #236

I wonder what the "author_is_elon", "author_is_power_user", "author_is_democrat", and "author_is_republican" labels are for [1]. [1]: https://github.com/twitter/the-algorithm/blob/main/home-mixe...

Elon is addressing this in the Twitter Space right now. "It definitely shouldn't be dividing people into Republican and Democrats; that makes no sense[...] you've identified something we should be getting rid of right away."

Does it make sense to divide people into Elon and not Elon?

Re: Twitter's Recommendation Algorithm

#274

Earlier quoted context omitted.

\* \* These author ID lists are used purely for metrics collection. We track how often we are \* serving Tweets from these authors and how often their tweets are being impressed by users. \* This helps us validate in our A/B experimentation platform that we do not ship changes \* that negatively impacts one group over others. \* From: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...

Still smells to high heaven to me. Not the Elon part, I don't really care about that. But collecting metrics about "republican" vs "democrat" sounds like a particularly bad set of priorities at work.

About 40% of US voters are not registered with any political party, so at least they will avoid whatever this triggers.

Re: Twitter's Recommendation Algorithm

#275

Say what you will about Elon, but this wouldn't have happened without him. Thanks! And thank you to everyone at Twitter who helped organize this release. Open sourcing something like this is no small effort.

I am not sure about that. Twitter has open sourced a lot of stuff in the past. There were certainly people there who would run the site as a nonprofit public service if they had the choice.

This release seems less immediately valuable than their other contributions, but historically more significant. It’s a pity we don’t have commits although that would be a huge privacy issue.

But yeah, while I would never work for Elon I’m glad he did this.

Re: Twitter's Recommendation Algorithm

#277

Earlier quoted context omitted.

Engineers who work at twitter can easily find another job in the US.

Can they? I don't know, but I imagine that at this point, everyone still working for Twitter is there because they don't have any other realistic option.

That's assuming too much in my opinion. Not everyone has the same or similar opinions regarding their work or Elon, even if it's hard for you to believe.

Re: Twitter's Recommendation Algorithm

#278

I wonder what the "author_is_elon", "author_is_power_user", "author_is_democrat", and "author_is_republican" labels are for [1]. [1]: https://github.com/twitter/the-algorithm/blob/main/home-mixe...

Here is a screenshot in case this changes later: https://i.imgur.com/F8GSeyH.png And, no, this wasn't in a merge-request, it was in the "main" branch of HomeTweetTypePredicates.scala.

What's all the "DDG"? Is this data from DuckDuckGo?

Re: Twitter's Recommendation Algorithm

#280
post #11

From https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... ( "author_is_elon", candidate => candidate .getOrElse(AuthorIdFeature, None).contains(candidate.getOrElse(DDGStatsElonFeature, 0L))), ( "author_is_power_user", candidate => candidate .getOrElse(AuthorIdFeature, None) .exists(candidate.getOrElse(DDGStatsVitsFeature, Set.empty[Long]).contains)), ( "author_is_democrat", candidate => candidate .getOrEls…

The full list of model features in that file is interesting. I am surprised at the number of inherently redundant and colinear features, though. (e.g. has_1_image, has_2_images, has_3_images, has_4_images)

Those aren't redundant or collinear though? Maybe you are surprised they didn't encode this as an integer "num_images"? It is fairly common to one hot encode ordinal variables with only a few common/possible values this way.
Post reply on HN