Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

921–930 of 1001 posts

Re: Twitter's Recommendation Algorithm

#921

Earlier quoted context omitted.

[flagged]

I would love to know where the OG users went before the reddit invasion completes. If anyone knows then please tell me!

They had kids, stopped using social media, and/or started charging for their insights.

Besides, if you have to ask, it’s not for you.

Re: Twitter's Recommendation Algorithm

#922

Earlier quoted context omitted.

Couple problems: 1. Actively supplying negative feedback is sometimes hidden behind secondary menus, making it much higher friction compared to just...scrolling past. So most users don't spend the effort. Even with a dislike button, it's unclear what the system is learning. It can't know that I don't like this particular video because it's a conspiracy theory, and to stop showing me those. These platforms often don't…

Twitter could recreate a similar system: 1) auto-tag tweets with labels, rather than users needing to submit to subreddits 2) auto-sub most people some default set of labels 3) let them un-sub if they want. They just don't want to.

Wait, Twitter already has this in the form of Topics. It's very coarse-grained, but still.

Re: Twitter's Recommendation Algorithm

#923
post #874

Great! But nothing is going to change until people realize that the problem is the feedback loop . It's not the recommendation engine itself, it's the fact that there's no way "out" of the feed that the engine produces. It recommends you stuff, you have little choice but to engage with it, and then it trains on that information . This is the problem with most of social media today. It is a very well known problem in…

So , all we need to do is to open source humans?

Haha no, we just need to stop pretending as if ML can read our minds. It's a tool, it's good at recommending me content, but it will never know what I'm in the mood for on a particular Friday night.

Re: Twitter's Recommendation Algorithm

#924
post #769

Earlier quoted context omitted.

Twitter contributed a lot to Map-Reduce, ETL and Scala communities: IMO they punched above thier weight. Sadly, I think their best open-source contribution days are behind them with all the hardcore engineering they now have to do with fewer engineers. Edit: I forgot about Bootstrap! That projects saved the world from millions of ugly web apps and dashboards built by clueless backend engineers.

On the other hand, I kinda loathe Bootstrap. I started web dev a bit after it peaked so maybe that's why but I'm so sick of the look and find it hard to think people ever thought it was good. Another trend Twitter popularized that I can't wait to die: absurdly large border-radiuses

[deleted]

Re: Twitter's Recommendation Algorithm

#926
post #906
post #904

Earlier quoted context omitted.

not with blue marks

I'm not in the US

It's actually non-US autharitarian governments that the biggest abusers, using social media against their own people

https://www.theguardian.com/technology/2021/apr/13/facebook-...

Re: Twitter's Recommendation Algorithm

#927

Earlier quoted context omitted.

I am not sure about that. Twitter has open sourced a lot of stuff in the past. There were certainly people there who would run the site as a nonprofit public service if they had the choice.

Twitter had 18 years to publish their algorithm under the previous management and they didn’t.

Twitter didn't get the algorithmic timeline until 2016. It also wasn't founded until 2006, so I don't know where your 18 years came from.

Re: Twitter's Recommendation Algorithm

#928
post #11

From https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... ( "author_is_elon", candidate => candidate .getOrElse(AuthorIdFeature, None).contains(candidate.getOrElse(DDGStatsElonFeature, 0L))), ( "author_is_power_user", candidate => candidate .getOrElse(AuthorIdFeature, None) .exists(candidate.getOrElse(DDGStatsVitsFeature, Set.empty[Long]).contains)), ( "author_is_democrat", candidate => candidate .getOrEls…

Update: Elon was asked about these in a Twitter Space, he says it's not appropriate and will be removed from the codebase. Additionally, from another Twitter engineer, the Democrat/Republican flags are apparently 10 years old and not important and do not have high feature importance.

I would say it’s who will be removed.

Considering how Twitter is now getting a servance isn’t that bad of an idea TBH

Re: Twitter's Recommendation Algorithm

#930

Great! But nothing is going to change until people realize that the problem is the feedback loop . It's not the recommendation engine itself, it's the fact that there's no way "out" of the feed that the engine produces. It recommends you stuff, you have little choice but to engage with it, and then it trains on that information . This is the problem with most of social media today. It is a very well known problem in…

I feel like the Youtube one is good. You can mark videos and channels as "not interested" and Youtbe really knows me due to my account age and usage... It recommends me unknown videos and I tend to like them but also more mainstream stuff.
Post reply on HN