Live data from Hacker News

Source code for the X recommendation algorithm

github.com

81–90 of 156 posts

Re: Source code for the X recommendation algorithm

#81

Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer. However, this gives roughly zero insight into how Twitter's feed behaves.

Not an ML expert, but is it feasible to train the weights using the actual Twitter feed as an oracle?

Re: Source code for the X recommendation algorithm

#82
post #50

Earlier quoted context omitted.

Elon’s father was not keen on him leaving South Africa from what I recall. There was an element of daddy doesn’t believe in me . He left against his fathers wishes. https://people.com/human-interest/elon-musk-errol-musk-relat... ’“He was such a terrible human being,” Elon, 46, told the magazine. “You have no idea.”’ Daddy issues out the ass. This is actually the simplest answer, because people that pursue external va…

This is the most shallow take on Elon I have read.

No it’s not. People who don’t take child abuse seriously say stuff like that. Michael Jackson is another case of a man who regularly brought up his father’s abuse. These are lifelong scars that show up in everything you do in your life if you don’t face it. Both Elon and MJ engage in drug abuse very late into life. If you stop looking at them as extraordinary humans, and just look at them as ordinary humans, you’ll see that they track the path of many with dark upbringings (they become dysfunctional in some form or another if they don’t face the reality of their journey). They have a veeeery fucked up concept of what human worth is because their caretakers disrespected them.

https://www.unicef.org/press-releases/nearly-400-million-you...

This is a common thing, not a hot take.

Re: Source code for the X recommendation algorithm

#84

Earlier quoted context omitted.

Post Musk Twitter is amazing. It lets you see how stories, opinions that you support or don’t are attacked from all sides and Community noted / @grok fact checked … a lot of UX changes too .. pre Musk, the moderation / banning was biased and arbitrary (who is watching the watchers?) .. my personal fav was to see the special tick removed from journalists ..

I think that's the first time I've seen someone positive about that change. My experience has been by showing blue tick users above others, the experience has become a lot more biased because it's only a certain type of person that pays for Twitter

Yes, people like me who CAN’T STAND TO SEE THEIR TYPOS etc. up there on display forever.

Re: Source code for the X recommendation algorithm

#85
post #56

Earlier quoted context omitted.

Not only no weights. Not sure what people's expectations are but a lot of the time this isn't even valid code with all the redaction they did [1]. I'm confused as to who this is for, this surely isn't the repo they're working on, is it? [1] https://github.com/twitter/the-algorithm/blob/main/trust_and...

This is 100% for headlines and Musk to be able to say "we're open" during interviews. Its actual usefulness is not the point

The reporters should be getting down to the point and asking Elon Musk about the practical usefulness of such a heavily redacted public release.

Re: Source code for the X recommendation algorithm

#86
post #81

Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer. However, this gives roughly zero insight into how Twitter's feed behaves.

Not an ML expert, but is it feasible to train the weights using the actual Twitter feed as an oracle?

It would cost a fortune in API calls, so it's not practical for anyone except internally at corporate.

Re: Source code for the X recommendation algorithm

#87
post #23

This is laudable. But the great thing about Twitter is that you don't have to use the algorithmic "For You" feed at all. You can just use the "Following" feed, which is purely chronological, and doesn't contain any recommended content. This isn't possible on Facebook, which makes it unusable for me.

I don’t use it - does it remember the setting? My recollection is that Facebook would make you switch to that chronological feed manually each time you load the page.

Re: Source code for the X recommendation algorithm

#88

Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer. However, this gives roughly zero insight into how Twitter's feed behaves.

It'd assume that weights are changing constantly so they'd need to open source a service tweaking the weights in real time rather than the weights themselves...

Re: Source code for the X recommendation algorithm

#89
post #54

Earlier quoted context omitted.

They seem to have dialed the overt Elon boosting down now but it's still conspicuously aligned with his priorities. I just made a fresh burner account to see what the algorithm is primed to push by default nowadays, and about 80% of the feed is anti-immigration ragebait.

I think that's just an accurate and mostly genuine indicator of who is left on twitter nowadays. The people left on twitter earnestly believe that it is better now that you can shout racial slurs at people, buy your way to the top of any chain, get literally paid for ragebait, and genuinely think this repo is meaningful. It's a massive self selection bias.

[deleted]

Re: Source code for the X recommendation algorithm

#90

Earlier quoted context omitted.

[flagged]

edit: disregard, misinterpreted

because the person you replied to said they worked (past tense) at twitter, unlike you who says they [currently] work (present tense) at twitter

why would they tell someone not working at twitter anymore to stop working at twitter? and how does that amount to "biased, hypocritical, one-way persecution"

Post reply on HN