Live data from Hacker News

Twitter's Recommendation Algorithm

blog.twitter.com

761–770 of 1001 posts

Re: Twitter's Recommendation Algorithm

#761
Are they measuring getting more republican posts? Because I'm getting a ton of those, which i constantly need to mute and ban ( mostly dumb remarks).

And i don't even live in the US.

It would explain why they are tracking it, to increase visibility.

Re: Twitter's Recommendation Algorithm

#762

Earlier quoted context omitted.

It has been my personal experience, over 25 years in the industry, that often times the bigger the company the worse the code. It's not an absolute rule, I've certainly inherited projects in a consulting capacity that were written by small teams and were atrocious. But more often than not, a small team working for a small company has fewer of the internal "forces" that incur "technical debt." Those forces are things…

Yep. I work for Big Tech, and our CI was lacking for a very long time. Integration testing isn't prioritized at all. Ironic to write code in an overly pedantic language with type safety, spend 3X that time on unit tests with near-100% coverage and what-if analysis, and still have the thing just not work in the end. For my own projects, I went TDD with integration tests first, and it paid off in both the short and lon…

I think the impressive thing would've been you being able to achieve that while coordinating with multiple other people. Anybody can write "perfect" code with enough reading/practice. I think being able to fit your code within the context of a codebase is another skillset entirely and presents entirely different challenges regardless of management influence

Re: Twitter's Recommendation Algorithm

#763

Earlier quoted context omitted.

So they could pretend to be open. It's the "Open"AI model. Open-washing?

This is a very cynical take. They should be commended for publishing recommendation code at all, which no other major social network does.

I’d give them more credit if they’d been honest and kept it secret then lie to my face and pretend they didn’t?

Re: Twitter's Recommendation Algorithm

#764
> The goal of our open source endeavor is to provide full transparency to you, our users, about how our systems work

the majority of users didn't ask for the this so not sure what's the exact motive behind thier efforts. it could be a PR stunt.

Re: Twitter's Recommendation Algorithm

#765

Earlier quoted context omitted.

Elon seems embarrassed: https://twitter.com/elonmusk/status/1641908130274525187?s=61... It’ll be interesting to see what gets cut. Maybe just the Elon flag, but maybe others too.

Elons reply “I only learned about it now!”. What a crock of shit. We literally went through reporting a few months back where he was clearly instructing the team to make sure his tweets always come up, for everyone.

> We literally went through reporting a few months back where he was clearly instructing the team to make sure his tweets always come up, for everyone.

Feel free to give me a source for that, but I'm pretty sure that's not true.

Re: Twitter's Recommendation Algorithm

#766

Earlier quoted context omitted.

Only used for metrics, apparently. [0] /** * These author ID lists are used purely for metrics collection. We track how often we are * serving Tweets from these authors and how often their tweets are being impressed by users. * This helps us validate in our A/B experimentation platform that we do not ship changes * that negatively impacts one group over others. */ [0]: https://github.com/twitter/the-algorithm/blob/7f…

So many unnecessarily cynical takes here. Let's say you were in charge of a large legacy system that some segment of customers complain about it not working for them as well as other segments. How would you know whether their complaints are valid unless you measured it? You have to know first. So measure it.

Elon has said he wanted more reach and experimented with getting it. He also loves attention and tweets a ton.

There’s benefit of the doubt then there’s just… whatever the polar opposite of that is.

Re: Twitter's Recommendation Algorithm

#767
post #11

From https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92... ( "author_is_elon", candidate => candidate .getOrElse(AuthorIdFeature, None).contains(candidate.getOrElse(DDGStatsElonFeature, 0L))), ( "author_is_power_user", candidate => candidate .getOrElse(AuthorIdFeature, None) .exists(candidate.getOrElse(DDGStatsVitsFeature, Set.empty[Long]).contains)), ( "author_is_democrat", candidate => candidate .getOrEls…

Coded as if the only two political parties on the planet were the Rs and the Ds. Shameful.

*as if the US is the only country out there

Re: Twitter's Recommendation Algorithm

#768
post #551

Earlier quoted context omitted.

That lines up with reporting from Casey Newton a few days ago where a handful of VIPs e.g. Musk, LeBron James, AOC were being used as weather vanes to understand what the algorithm was doing. It definitely isn't just metrics. Any algorithm change that negatively affected Musk was clearly not going live.

Do you think the code looked like that prior to Elon's purchase? I suspect that there was another name there before. Separately, which of these groups do you think that they use as a control?

I don't think so. If the token was "author_is_jake" for example, it would have changed to "author_is_ceo" on second pass

Re: Twitter's Recommendation Algorithm

#769

Earlier quoted context omitted.

I am not sure about that. Twitter has open sourced a lot of stuff in the past. There were certainly people there who would run the site as a nonprofit public service if they had the choice.

Twitter contributed a lot to Map-Reduce, ETL and Scala communities: IMO they punched above thier weight. Sadly, I think their best open-source contribution days are behind them with all the hardcore engineering they now have to do with fewer engineers. Edit: I forgot about Bootstrap! That projects saved the world from millions of ugly web apps and dashboards built by clueless backend engineers.

On the other hand, I kinda loathe Bootstrap. I started web dev a bit after it peaked so maybe that's why but I'm so sick of the look and find it hard to think people ever thought it was good.

Another trend Twitter popularized that I can't wait to die: absurdly large border-radiuses

Re: Twitter's Recommendation Algorithm

#770
post #263

Earlier quoted context omitted.

The importance of Twitter was it being the primary posting location for a lot of things. A number of the artists and other creatives I know have gotten absolutely gutted by this.

Gutted about what exactly? Twitter is still there and pretty much works like before.

> pretty much works like before

... did you see the source code? Blue checkmarks are weighted 4x as much as non-checkmarks. That's just one example of a major change that wouldn't have happened were it not for Elon

Post reply on HN