Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

821–830 of 1001 posts

Re: Twitter's Recommendation Algorithm

#821

I wonder what the "author_is_elon", "author_is_power_user", "author_is_democrat", and "author_is_republican" labels are for [1]. [1]: https://github.com/twitter/the-algorithm/blob/main/home-mixe...

Wait ... that was not a joke? And they actually removed it from the repo about 4 hours later? That doesn't look good.

Re: Twitter's Recommendation Algorithm

#822

Earlier quoted context omitted.

good point! "interesting insight" might have been a better phrase. i am just skimming twitter to get some scoops on the algo release

And I appreciate it. I'm looking forward to people analysing all of it so we eventually can get an in-depth lecture on both the techniques and their decisions.

I stopped posting because I realised I might get caught in some spam filter, but I think I'll now look some more, there are so many random tidbits you can find in a company's code, it really reflects a company's culture and journey sometimes.

Re: Twitter's Recommendation Algorithm

#823

Earlier quoted context omitted.

I thought it was interesting how it explicitly doesn't boost independents. So much of the two-party system is self-reinforcing.

The vast majority of self-proclaimed independents vote with one party just as reliably as registered members.

Majority? Probably. Vast majority? No way. If that were true we'd not keep switching parties between presidents. And Florida, a mostly independent voter state, wouldn't have had DeSantis win in a landslide when he just barely tied last time around.

Re: Twitter's Recommendation Algorithm

#824

Great! But nothing is going to change until people realize that the problem is the feedback loop . It's not the recommendation engine itself, it's the fact that there's no way "out" of the feed that the engine produces. It recommends you stuff, you have little choice but to engage with it, and then it trains on that information . This is the problem with most of social media today. It is a very well known problem in…

reminds me of a story about a guy who was given a gift, a decorative plate with a rooster on it i think it was. didn’t care for it too much, but out of politeness put it on display on an empty cabinet he had. a while later someone noticed he had it and figured he liked it, so got him a similar decorative plate with a rooster on it. again, out of politeness, he put it next to the old one. now other people started to t…

this is a hilarious example for a serious problem. well done!

Re: Twitter's Recommendation Algorithm

#825

Context: I teach at Princeton and study social media and recommendation systems. From a very quick skim of the repositories, this appears to be quite limited transparency. The documentation gives a decent high-level overview of how Tweet recommendation works—no surprises—and the code tracks that roadmap. Those are meaningful positive steps. But the underlying policies and models are almost entirely missing (there are…

> But the underlying policies and models are almost entirely missing... Without those, we can't evaluate the behavior and possible effects of "the algorithm

And neither can spammers find and test the cracks and edge cases that would allow them to break the system, that does sound reasonable to me. If they were public there would be an arms race between spammers/those wishing to game the system and Twitter engineers.

Re: Twitter's Recommendation Algorithm

#826
Did anyone else notice this below? I can’t even begin to imagine how many CPU’s that would require and what the cost must be… just for a recommendation engine.

> The pipeline above runs approximately 5 billion times per day and completes in under 1.5 seconds on average. A single pipeline execution requires 220 seconds of CPU time, nearly 150x the latency you perceive on the app.

Re: Twitter's Recommendation Algorithm

#827

https://twitter.com/jarokrolewski/status/1641892148084629504 > the main neural network part of @Twitter recsys algo is based on 2021 work of #SinaWeibo - Chinese clone of Twitter interesting claim

Some summaries I found online:

https://twitter.com/modern_mindset/status/164207843202770534...

    > Twitter algo is finally opensource.
    > • Twitter Blue 2x boosts 
    > • Likes have 30x comment value
    > • Links/mentions/names deboosts
    > • Retweets have 20x comment value
    > • Restrictions/suspensions deboost
    > • Images/videos/trending topics 2x boost

    > Will write a thread about it later. GM
https://twitter.com/petergyang/status/1642004729390858241

    > Twitter algo 101

    > Boosts
    > - Likes 30x
    > - Retweets 20x
    > - Twitter Blue 2-4x
    > - Trusted circle 3x
    > - Images/videos 2x
    > - Replies 1x

    > Negatives
    > - URL only
    > - No text
    > - Mute
    > - Block
    > - Unfollow
    > - Report

Re: Twitter's Recommendation Algorithm

#828
post #66
post #31

Earlier quoted context omitted.

The author_is_elon flag doesn't surprise me, but the two political designators are somewhat shocking. I'd sure like to know what changes based on what Twitter knows about your political affiliation.

The repo suggests it's about tracking engagement metrics[0], so Team Red people see more Team Red content and vice versa. Nothing nefarious. [0] https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...

[deleted]

Re: Twitter's Recommendation Algorithm

#829

https://twitter.com/jarokrolewski/status/1641892148084629504 > the main neural network part of @Twitter recsys algo is based on 2021 work of #SinaWeibo - Chinese clone of Twitter interesting claim

Some summaries I found online: https://twitter.com/modern_mindset/status/164207843202770534... > Twitter algo is finally opensource. > • Twitter Blue 2x boosts > • Likes have 30x comment value > • Links/mentions/names deboosts > • Retweets have 20x comment value > • Restrictions/suspensions deboost > • Images/videos/trending topics 2x boost > Will write a thread about it later. GM https://twitter.com/petergyang/statu…

Some threads on this topic (click to read full):

https://twitter.com/steventey/status/1641892389160894464

https://twitter.com/kaanayaz_/status/1641903611213930499

Re: Twitter's Recommendation Algorithm

#830

Earlier quoted context omitted.

Judging by the many "issues" already, it might have been a bad idea to release on a friday, though.

I'm not connecting the dots. Why is it bad to release on Friday?

Friday is traditionally end of the week and many people stressed out, tired, frustrated about the week and so on. So fridays the conversations are less nice online I noticed. So apparently many people used their friday frustration to blow off steam by spamming the github page with "issues" like, "rewrite everything in rust", "rewrite everything in scratch" ,... and while I was checking, many people were participating in this.
Post reply on HN