Live data from Hacker News

Twitter Should Open Up the Algorithm

every.to

101–110 of 138 posts

Re: Twitter Should Open Up the Algorithm

#101
post #28

Recommender systems like Twitter are as much about data as they are about code. Without the dataset and the derived statistics and models that are used for ranking and recall, the code is not going to help much with transparency.

Oh, you mean the matrix came up with rule to ban people talking about lab leak? but matrix can't figure out simple crypto bots and need humans to report and manually ban them?

Re: Twitter Should Open Up the Algorithm

#102
post #73

Earlier quoted context omitted.

On occasion, people make the same argument about all open source software, that making it public makes it insecure. Fortunately this has not turned out to be the case in reality. If there are flaws in the system they will probably be easier to find and fix with more eyes on it.

This is a terrible comparison. With OSS people are looking for security flaws . With a twitter/google algorithm people are trying to exploit the system when it works as intended. If there is a secret formula for a successful tweet, people will find it and repeat that behavior ad nauseum. The problem with google search isn't that people are exploiting 0-days that the developers aren't aware of. The problem is that the…

If there is a "secret formula" (exploit) then that is a flaw in the system that should be addressed, it will be discovered by the sufficiently motivated attackers, as it already is regularly. This is equivalent to security through obscurity, and it clearly is not working as you point out.

You assert that more eyes on the flaws would make the issue worse rather than better, but i disagree.

Re: Twitter Should Open Up the Algorithm

#103
Lots of good points here about how opening up the algorithm itself won't illuminate much and is technically extremely difficult without potentially devaluing the company since you would also have to open the data system behind the algorithm.

However, open sourcing any and all manual interventions over the algorithm + the guidelines used for evaluation and/or labeling (if any is done), would help to build a little bit of trust.

Not that much though, but it would be a start.

Re: Twitter Should Open Up the Algorithm

#104

"Open up the algorithm" is such a charmingly naive take on community moderation at scale that I can almost forgive the author for literally parroting Musk as the source of a lightweight take synthesized mostly from other people's thoughts in order to attract attention to his "Every" newsletter platform.

Do you consider Jack Dorsey naive on the subject? "The choice of which algorithm to use (or not) should be open to everyone" - Jack Dorsey https://twitter.com/jack/status/1507146276416098307

given that Jack Dorsey is also on the record for claiming that Bitcoin will lead to world peace I think it's fair to say the answer to that question is yes.

Re: Twitter Should Open Up the Algorithm

#105
post #57

if(tweet.author.affiliation == "democrat"){ promoteTweet(tweet); } else { shadowBan(tweet.author); }

Yishan Wong , the CEO of Reddit until 2012 have tweeted a long thread about how Musk doesn't understand the current state of moderation necessary because he was much more involved with an earlier Internet. But I am of opinion that Yishan is also behind as one half of the debaters simply left facts and reality behind. This post here is an example.

Re: Twitter Should Open Up the Algorithm

#106
post #92

Earlier quoted context omitted.

How/where does discovery happen?

As a pull, not a push. Meaning, in the very beginning, from off the chronological feed. Later, from following conversations of follows to new interesting accounts.

I suppose you can ditch twitter and switch to reddit.

Re: Twitter Should Open Up the Algorithm

#107

"Open up the algorithm" is such a charmingly naive take on community moderation at scale that I can almost forgive the author for literally parroting Musk as the source of a lightweight take synthesized mostly from other people's thoughts in order to attract attention to his "Every" newsletter platform.

Do you consider Jack Dorsey naive on the subject? "The choice of which algorithm to use (or not) should be open to everyone" - Jack Dorsey https://twitter.com/jack/status/1507146276416098307

I sure do. "The algorithm" fits nicely in articles complaining about unfair treatment, but it's not a real thing. Any mildly complicated reccomendation system is going to be 1) more than a single algorithm 2) far beyond the reasoning skills of laymen.

Re: Twitter Should Open Up the Algorithm

#108
I feel like authors are thinking about the "algorithm" almost as if it's just a bunch of if-else statements in a tree.

Read only audit is an overly naive way to think about understanding complex algorithms. In an audit they would find an enable of large DNN transformer models with thousands of layers and thousands of features often with their own transformation trees. There are entire CS departments dedicated to researching tools to understand complex nonlinear models. You definitely can't do with a read only code audit. You can _barely_ do it with full access to the model, full access to the input data and being able to retrain and rerun the model on that data.

Re: Twitter Should Open Up the Algorithm

#109
post #41
post #3

Oh my. Twitter, or any other platform, is not your megaphone that will amplify your opinion without restrictions. Don't like that? Start your own platform, and see how that turns out. Related: yes, I do support interoperability requirements between platforms. No, that still doesn't mean you get to blast your opinion all over the internet without hitting a roadbump every now and then.

> Oh my. Twitter, or any other platform, is not your megaphone that will amplify your opinion without restrictions Where did this sentiment originate from? I never heard of it before and all of a sudden in the last few years I hear so many people parroting it. Why is it that all these people were silent for so long and now they're yelling in unison about how bad Twitter as a megaphone is?

For YouTube at least I can give a clear example. I’m pretty sure they’ve cleared this up now but for a while you had no way to get consistent notifications of new content from creators you’d explicitly subscribed to. Twitter is similar in this way. If I follow someone, I want to see their tweets. Full stop.

I don’t want them arbitrarily hidden from my timeline by an algorithm. Twitter offers a chronological timeline but has repeatedly reset my user preference for it. If there weren’t third party applications that respected my preference I definitely would not be using it anymore.

Re: Twitter Should Open Up the Algorithm

#110
post #89

Amazingly Naive. Just the data and code needed to make the “algo” scale to what it is means there is no good way to “open it up”. But let’s say, and why not, that it actually was opened. I can see it now, everyone and their mother would be recommending changes to it. People would want it at the extremes, or tweaked to just not recommend their pet peeves. And if they did not get their way, they would go off in a huff…

I think they're looking for a statement like: if (tweet.from in bad_users): score *= 0.8 Do they have the levers in place to manipulate results or is it a clear objective scoring system that shows what you see on your feed and search results? I believe they have something like this. To what extent its being manipulated is a separate question.

that's why a lot of responders are calling the approach naive. This function is potentially the last layer in thousands of functions. Thinking that one can predictably change the behavior of a large nonlinear model via one variable is like thinking you can change the US political system by passing one good law in Reno, Nevada.

This approach only works if auditability is mandated to also be a property of the model, which typically reduces model complexity and accuracy too. We do this with credit scoring models semi-successfully.

Post reply on HN