This is something the right leaning groups have always been saying, but it is exciting that the article manages to come up with an empirical way to determine the "belief system" of the AI model. People on the left shouldn't rejoice either. The left and the right wing are mostly the same, and both follow similar approaches to marginalize people who they feel are undesirable, so it'll eventually come back to bite the l…
[flagged]
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
91–100 of 697 posts
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#92I think most people would agree that a lot of the content on the internet is left-leaning. It seems obvious in hindsight, but I'd never considered it before, that training an AI model on that content would introduce a bit of a bias We all know garbage in, garbage out. But liberal in, liberal out is an interesting idea, and I'm not sure how you fix it
From a local perspective, it might seem that these are two equal sides. In rural parts of the country, it seems like everyone is a twelver, so the right-wing party has large support.
But from a global perspective, there is no contest. Globally, humanity doesn't want a theocracy, and even most Muslims don't subscribe to that particular flavor of Islam so they don't want that either. Although they might be a majority within their country, globally they are a very, very small and unimportant minority that nobody takes seriously. Because the Internet is a global space, that is exactly how they will be treated. I certainly wouldn't expect ChatGPT to spout their party line, would you?
The same logic applies to all right-wing parties. "America first" might sound good to an American surrounded by other Americans, but it won't be received well in an Internet forum where many people are not American, and won't become part of the global discourse because it's completely irrelevant to the vast majority of humans. On the Internet you don't know anyone's nationality, religion, race etc., and culture can only be "local" to the extent that it is local to a particular website.
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#93Why do we see an issue if AI is biased, while 90% of media run by humans are biased too? Every single individual has its own bias, so why it's an issue for an AI. If we look at the many topics, there's no universal objective truth, truth is what we define as truth, and again, not everyone agrees at it.
Because you have a large number of media outlets. There's at least one media outlet for every relatively big ideology or demographic. And these biases are well understood by people. With LLMs, you'll probably end up only having 2 or 3 companies, and it wouldn't be surprising if they all end up having silicon valley, left leaning biases. You can tune Fox news, but you can't use a "right wing chat gpt".
You can build your own with the GPT API. I started playing with it and it returned racial slurs in response to innocuous prompts like "hello" and "ok". Seems perfectly tuned out of the box for the kind of speech that the right is interested in these days.
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#94Seems like a pretty easy fix. I would argue though that there's a larger body of "hateful" content out there targeting those specific groups, which is probably why its more keen to trigger on those vs others. For example, the racial group you're most likely to get past the hate filter on is.... Native Americans. Now, while there's certainly a long history of hateful rhetoric against them, in modern discourse there's…
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#95This is something the right leaning groups have always been saying, but it is exciting that the article manages to come up with an empirical way to determine the "belief system" of the AI model. People on the left shouldn't rejoice either. The left and the right wing are mostly the same, and both follow similar approaches to marginalize people who they feel are undesirable, so it'll eventually come back to bite the l…
I don't know why left wing groups would celebrate. Other than the conservative category, most of the descriptors he used were inborn traits like being straight, being white, being a man, or immutable attributes like being from a particular country. (And honestly, being conservative may be one of those traits too, but it's less obviously true). I know it's common to look at the most unhinged people on Twitter and say…
So if your image of left is "twitter left" maybe reconsider recalibrating it to "half of hn."
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#96This is something the right leaning groups have always been saying, but it is exciting that the article manages to come up with an empirical way to determine the "belief system" of the AI model. People on the left shouldn't rejoice either. The left and the right wing are mostly the same, and both follow similar approaches to marginalize people who they feel are undesirable, so it'll eventually come back to bite the l…
I don't know why left wing groups would celebrate. Other than the conservative category, most of the descriptors he used were inborn traits like being straight, being white, being a man, or immutable attributes like being from a particular country. (And honestly, being conservative may be one of those traits too, but it's less obviously true). I know it's common to look at the most unhinged people on Twitter and say…
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#97Earlier quoted context omitted.
How do you define fair, mathematically if possible ?
Maybe I worded it badly. I was attempting to make a distinction between moderation rules that are designed to be fair based on some world view VS rules that are automatically generated based on some sample set to appear convincingly fair to us. In essence the AI is just giving us what the majority of it's test data tells it that we want to hear.
But the whole point is, there's no such thing as "objective", especially when you start talking about people. There's no place to stand as a human being that doesn't involve experiencing the world through one's own consciousness, which has an implicit value structure. Everyone has their own little "religion", and when they share that worldview with other people, the religion then becomes that which holds the group together. "Ligament" (that which holds bones together) and "religion" (that which holds groups together) have the same root: "lig" which means "to bind".
AI is revealing this to a large segment of our population that considers themselves "objective" and "secular", and the cognitive dissonance that is coming out as a result is funny and disturbing in equal parts.
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#98[flagged]
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#99This reminds me of a HN article that appeared yesterday: "The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever" https://news.ycombinator.com/item?id=34618376 Like its own output, it's moderation rules are optimized to appear fair, rather than actually be truly fair. Also I'm…
How do you define fair, mathematically if possible ?
Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
#100Why do we see an issue if AI is biased, while 90% of media run by humans are biased too? Every single individual has its own bias, so why it's an issue for an AI. If we look at the many topics, there's no universal objective truth, truth is what we define as truth, and again, not everyone agrees at it.