Live data from Hacker News

twitter/the-algorithm

github.com

151–160 of 403 posts

Re: twitter/the-algorithm

#151

Earlier quoted context omitted.

Twitter Locks Down Product Changes After Agreeing to Musk Bid - https://finance.yahoo.com/news/twitter-locks-down-product-ch...

Are there precedents of this? This looks like there is not much trust internally. I doubt this was the first Elon’s decision

Well you’re reading about it here so clearly there are employees who aren’t above breaking the rules a bit ;)

Re: twitter/the-algorithm

#152
post #116
post #95

I've worked on very large scale recommendation systems at a FAANG. If Twitter's system resembles anything like ours, the concept of publishing or open sourcing "the algorithm" doesn't make sense. Even if we were to open source all associated code and publish all related documents it would be very difficult to make sense of the entire system. That is precisely why companies such as Twitter A/B test the hell out of eve…

Of course it doesn't make sense. I think it's just a dog whistle to the people who believe google have a guy in a room somewhere turning the "conservative search results" lever down a notch during elections.

> turning the "conservative search results" lever

It may not have been algorithmic, but it definitely happened.

Re: twitter/the-algorithm

#154
post #74

Earlier quoted context omitted.

You forgot the gigantic amount of human intervention required to unperson people who tweet against Twitter‘s political interests

What does "unperson" mean?

It’s lazy shorthand for “belatedly apply their policies against hate speech to prominent politicians”.

Re: twitter/the-algorithm

#155
post #33

I know the algorithm i use, it ends with ORDER BY date DESC.

Is that actually possible on Twitter? (I have an account but don't use it.) I do believe them that when a user follows several 100+ other users, it would probably be impossible to read every tweet chronologically.

Re: twitter/the-algorithm

#156
post #146
post #95

I've worked on very large scale recommendation systems at a FAANG. If Twitter's system resembles anything like ours, the concept of publishing or open sourcing "the algorithm" doesn't make sense. Even if we were to open source all associated code and publish all related documents it would be very difficult to make sense of the entire system. That is precisely why companies such as Twitter A/B test the hell out of eve…

I don't believe the point was ever to convey an complete understanding of the system, but to allow for the identification of "red flags": Specific functions that would be deemed controversial or counter to equal opportunity speech.

Is the idea somewhere in the-algorithm there's a function called `derankGOPMembers()`?

Twitter's been pretty transparent in how it "deranks" certain accounts [1]. What more would come from opening the code that certainly not include the actual database of "no no terms" (if you were to believe that exists)?

[1] https://blog.twitter.com/en_us/topics/company/2022/our-ongoi...

Re: twitter/the-algorithm

#157
post #95

I've worked on very large scale recommendation systems at a FAANG. If Twitter's system resembles anything like ours, the concept of publishing or open sourcing "the algorithm" doesn't make sense. Even if we were to open source all associated code and publish all related documents it would be very difficult to make sense of the entire system. That is precisely why companies such as Twitter A/B test the hell out of eve…

Understood and several of us have dealt with large complex systems.

Open sourcing algorithm or code is not about everyone go and analyze the same, instead when controversy or issues arise it'll be readily available for independent experts to review it.

Re: twitter/the-algorithm

#158
post #99
post #82

I don't understand the concept of open-sourcing "the algorithm". First of all, "the algorithm" is probably hundreds of thousands of lines of code, including all the tedious boilerplate like cache policies and multi-AZ logic. And second of all, doesn't the algorithm include machine learning components, which are trained on terabytes of data? That data will likely be impossible to open source. And open sourcing the neu…

Or is it six cats in a basement with a laser pointer and a mouse? The point of releasing it is to let people know exactly why they see the tweets they do in the order they do. I hope Elon just goes back to time base ordering of tweets.

Maybe it's a room full of lava lamps.

Re: twitter/the-algorithm

#159
post #95

I've worked on very large scale recommendation systems at a FAANG. If Twitter's system resembles anything like ours, the concept of publishing or open sourcing "the algorithm" doesn't make sense. Even if we were to open source all associated code and publish all related documents it would be very difficult to make sense of the entire system. That is precisely why companies such as Twitter A/B test the hell out of eve…

The openness for the algorithm is to make public how the algorithm works internally. It has nothing to do with how "novel" or "good" or "bad" the algorithm is. It is just a way to check if there is anything fishy going on in there. I don't see what the fuss is about if it only makes the defacto town square of the internet more transparent and open.

Re: twitter/the-algorithm

#160

Is this supposed to be a joke? It's clearly an empty repo. Either this is a mistake, or this is a really, really misguided attempt at a joke from Twitter.

It wouldn't surprise me. It wouldn't be the first joke about him and his buyout.

https://twitter.com/TwitterComms/status/1511456430024364037

Post reply on HN