RIP author_is_elon, we hardly knew ye. https://github.com/twitter/the-algorithm/issues/236
Republican, Democrat, and Elon. Wow.
[deleted]
Source code for the X recommendation algorithm
31–40 of 156 posts
Re: Source code for the X recommendation algorithm
#32[dead]
Re: Source code for the X recommendation algorithm
#33This is laudable. But the great thing about Twitter is that you don't have to use the algorithmic "For You" feed at all. You can just use the "Following" feed, which is purely chronological, and doesn't contain any recommended content. This isn't possible on Facebook, which makes it unusable for me.
That ignores the way Twitter sorts replies, which always use an algorithmic weight-based listing.
Not if you sort by recency or likes.
Re: Source code for the X recommendation algorithm
#34I've always wondered - how can I as a non X engineer be sure that the code on GH is actually deployed on their servers?
It’s not. The last “algorithm” release was a random grab bag of code which existed in some of the Twitter repo that might have been tangentially related to recommendations/feed. Source: worked at Twitter in ML/recsys.
[flagged]
Re: Source code for the X recommendation algorithm
#35Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer. However, this gives roughly zero insight into how Twitter's feed behaves.
For all its flaws .. it’s still a step up from how Parag and co used to run twitter
Re: Source code for the X recommendation algorithm
#36This is laudable. But the great thing about Twitter is that you don't have to use the algorithmic "For You" feed at all. You can just use the "Following" feed, which is purely chronological, and doesn't contain any recommended content. This isn't possible on Facebook, which makes it unusable for me.
That ignores the way Twitter sorts replies, which always use an algorithmic weight-based listing.
On iOS at least, there is a “Sort replies > latest” option which is strictly chronological
Re: Source code for the X recommendation algorithm
#37Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer. However, this gives roughly zero insight into how Twitter's feed behaves.
the criteria for deciding which posts in comments or feed are spam or should be otherwise be suppressed are unsurprisingly also hidden . It's known that blue checkmark accounts rank above non-verified ones for comments, but I dunno about feed visibiblity.
Re: Source code for the X recommendation algorithm
#38Earlier quoted context omitted.
It’s not. The last “algorithm” release was a random grab bag of code which existed in some of the Twitter repo that might have been tangentially related to recommendations/feed. Source: worked at Twitter in ML/recsys.
[flagged]
Even if this is the actual production code at this very second, it won't match prod for long if they continue this pattern of only dropping an update every two years or so.
Re: Source code for the X recommendation algorithm
#39Always good to see some Scala in the wild. :)
Re: Source code for the X recommendation algorithm
#40I tried going through the latest diff, but there is so much boilerplate that I was nt able to find any real insights through skimming.
Has anyone found anything useful? Interesting needle-in-a-haystack problem for LLMs to try as well.