Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

221–230 of 1001 posts

Re: Twitter's Recommendation Algorithm

#221
post #180

Squashing the commit history before releasing it was an interesting (and completely predictable) decision.

If they allowed you to git-blame the algorithm, some poor coder would have definitely gotten murdered by a crazy person who thought they purposely changed something to hurt them

Re: Twitter's Recommendation Algorithm

#222
Democrats / Republicans looks like it was added outside of SDLC [1]. This order without those features is sorted, likely by a linter, suggesting Elon and Vits are properly implemented, and Democrats/Republicans was just inserted alongside the Elon feature, perhaps just for this extract. Sorting it now results in a different order than the commit.

[1]: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...

Re: Twitter's Recommendation Algorithm

#223
post #82

> Twitter has several Candidate Sources that we use to retrieve recent and relevant Tweets for a user. For each request, we attempt to extract the best 1500 Tweets from a pool of hundreds of millions through these sources. We find candidates from people you follow (In-Network) and from people you don’t follow (Out-of-Network). > Today, the For You timeline consists of 50% In-Network Tweets and 50% Out-of-Network Twee…

Perhaps if you did follow so many people they got drowned out, but with substantially fewer following, those recommended tweets were a big part of what I saw. Especially in the last year or so before Musk took over: Twitter went a lot more aggressive and didn't just show tweets which people you follow "liked", but also other tweets, which the algorithm somehow determined you might like, which was often wrong, and, moreover, so frequent that it made a big portion of the timeline. The "following" tab fixed this problem.

Re: Twitter's Recommendation Algorithm

#224
post #169
post #136

Earlier quoted context omitted.

I believe LeBron James said recently he isn't going to waste his money on a blue checkmark, so it should be interesting to see what stays and what goes.

LeBron doesn’t get $84 of value from Twitter? Definitely not a political statement going on there.

Parent didn’t say it’s not “political”. It’s reasonable for a wealthy person to feel that a system that discriminates against the poor is not a system they want to participate in.

(Note that I use discriminate in the literal sense, as a simple statement of fact.)

Re: Twitter's Recommendation Algorithm

#226

  For ranking the candidates these predictions are combined into a score by 
  weighting them:
  
  "recap.engagement.is_favorited": 0.5 
  "recap.engagement.is_good_clicked_convo_desc_favorited_or_replied": 11* (the 
  maximum prediction from these two "good click" features is used and weighted by 
  11, the other prediction is ignored). 
  "recap.engagement.is_good_clicked_convo_desc_v2": 11* 
  "recap.engagement.is_negative_feedback_v2": -74 
  "recap.engagement.is_profile_clicked_and_profile_engaged": 12 
  "recap.engagement.is_replied": 27 
  "recap.engagement.is_replied_reply_engaged_by_author": 75 
  "recap.engagement.is_report_tweet_clicked": -369 
  "recap.engagement.is_retweeted": 1 "recap.engagement.is_video_playback_50": 0.005
Who set those weights, and why were they chosen?

Re: Twitter's Recommendation Algorithm

#227
post #165

Earlier quoted context omitted.

AGPL is probably useless for any other site who'll want to use it, as it would require them to open source their site that uses it.

Mastodon is conveniently also AGPL...

On reason I use Mastodon is that there is just chronological timeline. Quick scroll and you are done. Bad for advertising platform - good for user.

Re: Twitter's Recommendation Algorithm

#228

Earlier quoted context omitted.

LOL. My algorithm at twitter had been very simple- See tweets from people I followed. Don't see tweets from people I didn't follow. Trust people I follow in their retweets to signal something interesting. Unfollow unhelpful people. Once that algorithm was rendered impossible, I left twitter. Haven't missed it. Having someone say- here's the way we are going to promote something to you- doesn't make me inclined to acc…

This still exists as the Following tab and viewing it is a persistent option. You don’t need to see the algorithm feed (“For You”) ever.

Roughly one in every four to five tweets in the “following” feed is a “promoted” tweet, at least on mobile.

20-25% noise isn’t a great ratio for something that I ostensibly curate.

Re: Twitter's Recommendation Algorithm

#229
post #82

> Twitter has several Candidate Sources that we use to retrieve recent and relevant Tweets for a user. For each request, we attempt to extract the best 1500 Tweets from a pool of hundreds of millions through these sources. We find candidates from people you follow (In-Network) and from people you don’t follow (Out-of-Network). > Today, the For You timeline consists of 50% In-Network Tweets and 50% Out-of-Network Twee…

A year ago my account with 5700 followers got an average of 3000 impressions per post (art). Today it's only 200-500. It mentions their fanout system was replaced by something new, not sure when or if thats in the drop, but my impression count dropped around April-May last year. Clearly something decided my posts should not shown to my followers very often.

Re: Twitter's Recommendation Algorithm

#230

So as expected, there is exactly nothing that favors posters from one side of the political spectrum. I don't expect that this article will do anything to calm down those who are convinced otherwise though. Well written article, from an engineer's perspective.

Well, it does say this:

   Ranking is achieved with a ~48M parameter neural network that is continuously trained on Tweet interactions to optimize for positive engagement (e.g. Likes, Retweets, and Replies). This ranking mechanism takes into account thousands of features and outputs ten labels to give each Tweet a score, where each label represents the probability of an engagement. We rank the Tweets from these scores. 
This is basically the ultimate black box, so I don't think you can really conclude anything like this either way.
Post reply on HN