Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

841–850 of 1001 posts

Re: Twitter's Recommendation Algorithm

#842
post #679

Earlier quoted context omitted.

You can dismiss the complaint without measurement if you are confident in two things: 1. Your system does nothing to actually segment this specific group by their identity. 2. You are confident that the systems you have set up to reward good behavior and punish bad behavior are accurate. If both of those are true, you know that even if the group is being disproportionately negatively impacted by some form of recommen…

> ...it is only because that group disproportionately participates in behavior that is bad for the platform. That isn't a problem. That is exactly what Twitter's stance has been all along (in the pre-Elon era) and it IS a problem for the product because people being silenced due to their own bad behavior (example: misgendering transgender people) feel an injustice is being done. The rule-makers get to set the range o…

[flagged]

Re: Twitter's Recommendation Algorithm

#843
post #551

Earlier quoted context omitted.

Do you think the code looked like that prior to Elon's purchase? I suspect that there was another name there before. Separately, which of these groups do you think that they use as a control?

> I suspect that there was another name there before Who ? Musk is unique in being obsessed with being liked and relevant. All of the other social CEOs including Porag and Jake have never really cared that much. And none of them participated in contributing content anything close to what Musk does.

>Who ? Musk is unique in being obsessed with being liked and relevant.

This is a meta-level bias!

Re: Twitter's Recommendation Algorithm

#844

Earlier quoted context omitted.

[flagged]

Or an alternative view: no matter what he does there will always be haters and there are massive (political) incentives to destroy his public persona. Those incentives also align nicely with those of hedge funds that are short TSLA as well as family offices that are short Tesla (hello Billy boy Gates).

You can't argue this alternative view in good faith because he now has such a long record of pulling the wool over people eyes.

Its just mainstream now and so it looks likes its partisan but to be honest people in the legacy auto and space industry have been screaming from the rooftops for years but no one listened to them.

Re: Twitter's Recommendation Algorithm

#845
post #11

From https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... ( "author_is_elon", candidate => candidate .getOrElse(AuthorIdFeature, None).contains(candidate.getOrElse(DDGStatsElonFeature, 0L))), ( "author_is_power_user", candidate => candidate .getOrElse(AuthorIdFeature, None) .exists(candidate.getOrElse(DDGStatsVitsFeature, Set.empty[Long]).contains)), ( "author_is_democrat", candidate => candidate .getOrEls…

Update: Elon was asked about these in a Twitter Space, he says it's not appropriate and will be removed from the codebase. Additionally, from another Twitter engineer, the Democrat/Republican flags are apparently 10 years old and not important and do not have high feature importance.

He's only upset that people found out about it.

If they remove his artificial boosts, he'll just turn around and shout at his engineers to reinolement it in another way.

Re: Twitter's Recommendation Algorithm

#846

Earlier quoted context omitted.

I expect they're tracking the red team/blue team metrics because of the political shitstorm that's been the GOP's assertions they're being silenced by The Algorithm.

The fallacy of false equivalence systematized in code. Now one side can spew as much disinfo and incitement to violence as it likes, and any algorithm change that prevents this shit from getting amplified will be rejected as bias. BSaaS = Both Sides as a Service

I don't see an unbiased way to tell which "side" releases more disinformation and incitement to violence. Even deciding what counts as disinformation is hard (e.g. does it have to be literally false or just cause false beliefs in the reader?).

Re: Twitter's Recommendation Algorithm

#847
post #826

Did anyone else notice this below? I can’t even begin to imagine how many CPU’s that would require and what the cost must be… just for a recommendation engine. > The pipeline above runs approximately 5 billion times per day and completes in under 1.5 seconds on average. A single pipeline execution requires 220 seconds of CPU time, nearly 150x the latency you perceive on the app.

5e9 * 220 / 3600 / 24 implies they are using 12 million cpu cores continuously? That seems nearly implausible, but perhaps it's true?

Re: Twitter's Recommendation Algorithm

#848

Earlier quoted context omitted.

Elon seems embarrassed: https://twitter.com/elonmusk/status/1641908130274525187?s=61... It’ll be interesting to see what gets cut. Maybe just the Elon flag, but maybe others too.

Elons reply “I only learned about it now!”. What a crock of shit. We literally went through reporting a few months back where he was clearly instructing the team to make sure his tweets always come up, for everyone.

Yeah but presumably he didn't think the devs would tag a specific metric for "elon", which would later be open-sourced. It's one of those things that makes more sense in retrospect...

Re: Twitter's Recommendation Algorithm

#849
post #506

Earlier quoted context omitted.

Also how about.... everyone else in the world who is not an American voter?

Before I deliberately locked myself out of it (well before Musk), I asked for my data. They classify me as: * speaks Indonesian Interested in: * Beer * Cricket * DJs * Dance * Enterprise software * Horror * NFL football * South America And aged either between 13-54 or (and?) over 65 Other than the age (I'm neither under 13 nor between 55-64), everything I've listed is incorrect. On that basis, they'd probably call me…

Aren't "enterprise software" and "horror" the same thing?

Re: Twitter's Recommendation Algorithm

#850

Earlier quoted context omitted.

Elons reply “I only learned about it now!”. What a crock of shit. We literally went through reporting a few months back where he was clearly instructing the team to make sure his tweets always come up, for everyone.

If I remember correctly, he noticed that his account with 100,000,000 plus followers was only getting 40,000 or so views. This lead to a Twitter engineer saying maybe his content wasn't interesting enough to get views and getting fired. And later on Musk said that they found a bug in the fanout system because his account was so big it basically broke things and they fixed it. I remember everyone agreeing with the Twi…

The fanout bug was in weighting how blocks affect visibility and fanout. Apparently it was an absolute and not a relative thing, so the huge amount of blocks musk has affected their visibility.
Post reply on HN