Asking Bard to write stories prompted by character names reveals racial biases
1–10 of 12 posts
Re: Asking Bard to write stories prompted by character names reveals racial biases
#2I'm not sure this is indicative of a failing on Bard and Google's parts. I think most movie/dramas that humans create often follow these stereotypes. AIs like Bard train on the content that humans make and build connections based on that.
I think it leads to an interesting question, is it Google's responsibility to try to counter every stereotype or try to make about that operates like a human?
Re: Asking Bard to write stories prompted by character names reveals racial biases
#3I'm not sure this is indicative of a failing on Bard and Google's parts. I think most movie/dramas that humans create often follow these stereotypes. AIs like Bard train on the content that humans make and build connections based on that. I think it leads to an interesting question, is it Google's responsibility to try to counter every stereotype or try to make about that operates like a human?
I think that ship has sailed some time ago, all these big tech companies have been talking about needing to manipulate results to hide such biases for years now (eg making it so an image search for "CEO" shows a balanced mix of all kinds of people instead of honestly reflecting whatever the untouched results might look like).
Re: Asking Bard to write stories prompted by character names reveals racial biases
#4AIs reflecting what their trainers wish they observed in their training datasets are completely uninteresting.
Re: Asking Bard to write stories prompted by character names reveals racial biases
#5Re: Asking Bard to write stories prompted by character names reveals racial biases
#6I wonder how much of this is actually age bias, would it be more likely to make them criminals if they chose young but white sounding names or explicitly suggested an age?
Re: Asking Bard to write stories prompted by character names reveals racial biases
#7I'm not sure this is indicative of a failing on Bard and Google's parts. I think most movie/dramas that humans create often follow these stereotypes. AIs like Bard train on the content that humans make and build connections based on that. I think it leads to an interesting question, is it Google's responsibility to try to counter every stereotype or try to make about that operates like a human?
Q: How to change the UX to be more ethical?
As a Reminder, having an Italian name means nothing innately, about my level of criminality, regardless of what Bard tells you.
@craboof, Refocusing your question to, "should GOOG Bard try to be ethical than it currently is": yes. GOOG can do more harm quickly, generating stereotypical content, than a modern human.
Yes, this is a wildly awful failure. It should not have been shipped - it is harmful - it should stop being "the norm" to ship such poorly disclaimed features.
_I_ am sure this is fail because the harm clearly outweighs the mitigation. I see the generated content and its consequential harm: it is reinforcing negative stereotypes. I do NOT see GOOG's mitigation through the ..not shown here.. disclaimer, "This Is beta/alpha/incomplete/whatever". That disclaimer is elsewhere. The disclaimer needs to be EVERYWHERE. That's a failure on GOOG's part.
To extrapolate, I think that amplifying stereotypes is one of the worst harms this tool can do to us humans, right now. Worse than this would be to create deadly situations for humans -- and stereotypes CAN lead to death, so this is pretty awful.
PLEASE Correct my 'formal' ethics: This seems 'consequentially' unethical. Versus immediately. GOOG is not actively killing puppies each time it generates an AI Story. However any future usage of the story will do harm.
Ref:
https://ind.ie/ethical-design/ - indirectly, guidance on what Bard should look like instead of what it does today
Re: Asking Bard to write stories prompted by character names reveals racial biases
#8I wonder how much of this is actually age bias, would it be more likely to make them criminals if they chose young but white sounding names or explicitly suggested an age?
The Bard UI _should_ include sources, to give the human content-consumer some context about its bias.
Re: Asking Bard to write stories prompted by character names reveals racial biases
#9I'm not sure this is indicative of a failing on Bard and Google's parts. I think most movie/dramas that humans create often follow these stereotypes. AIs like Bard train on the content that humans make and build connections based on that. I think it leads to an interesting question, is it Google's responsibility to try to counter every stereotype or try to make about that operates like a human?
I think that ship has sailed some time ago, all these big tech companies have been talking about needing to manipulate results to hide such biases for years now (eg making it so an image search for "CEO" shows a balanced mix of all kinds of people instead of honestly reflecting whatever the untouched results might look like).
Because the norm is "bad" means that it needs to be changed.
From my perspective as a random SWE, big tech companies' incentives do not seem to be to change that "bad".
We are now in an oligarchical phase of USA, society & economy. There are "bads" associated with that. And the technology that you and I create does not NEED to pander to that. (Perhaps if you want a paycheck from GOOG then you will be encouraged to support the status quo.)
Re: Asking Bard to write stories prompted by character names reveals racial biases
#10Earlier quoted context omitted.
I think that ship has sailed some time ago, all these big tech companies have been talking about needing to manipulate results to hide such biases for years now (eg making it so an image search for "CEO" shows a balanced mix of all kinds of people instead of honestly reflecting whatever the untouched results might look like).
Because the norm is "bad" means that it needs to be changed. From my perspective as a random SWE, big tech companies' incentives do not seem to be to change that "bad". We are now in an oligarchical phase of USA, society & economy. There are "bads" associated with that. And the technology that you and I create does not NEED to pander to that. (Perhaps if you want a paycheck from GOOG then you will be encouraged to su…
I'm not really saying if it's bad or not, my personal opinion is that it's weird and not something I wholeheartedly support, but I also don't really care that much because I think it'd be dumb for anyone to be trying to draw their worldview on who can become a CEO based on image search results.