>While we leave an in-depth empirical analysis of social and cultural biases to future work, our small scale internal assessments reveal several limitations that guide our decision not to release our model at this time. Some of the reasoning: >Preliminary assessment also suggests Imagen encodes several social biases and stereotypes, including an overall bias towards generating images of people with lighter skin tones…
Imagen, a text-to-image diffusion model
131–140 of 661 posts
Re: Imagen, a text-to-image diffusion model
#132Re: Imagen, a text-to-image diffusion model
#133Earlier quoted context omitted.
How can we prepare for this? This will result in mass social unrest.
Stock up on guns, ammo, cigarettes, water filters, canned food, and toilet paper.
Re: Imagen, a text-to-image diffusion model
#134Earlier quoted context omitted.
This raises some really interesting questions. We certainly don't want to perpetuate harmful stereotypes. But is it a flaw that the model encodes the world as it really is, statistically, rather than as we would like it to be? By this I mean that there are more light-skinned people in the west than dark, and there are more women nurses than men, which is reflected in the model's training data. If the model only gener…
> But is it a flaw that the model encodes the world as it really is Does a bias towards lighter skin represent reality? I was under the impression that Caucasians are a minority globally. I read the disclaimer as "the model does NOT represent reality".
Re: Imagen, a text-to-image diffusion model
#135Earlier quoted context omitted.
Looks like no, "The potential risks of misuse raise concerns regarding responsible open-sourcing of code and demos. At this time we have decided not to release code or a public demo. In future work we will explore a framework for responsible externalization that balances the value of external auditing with the risks of unrestricted open-access."
> the risks of unrestricted open-access What exactly is the risk?
Re: Imagen, a text-to-image diffusion model
#136Earlier quoted context omitted.
This raises some really interesting questions. We certainly don't want to perpetuate harmful stereotypes. But is it a flaw that the model encodes the world as it really is, statistically, rather than as we would like it to be? By this I mean that there are more light-skinned people in the west than dark, and there are more women nurses than men, which is reflected in the model's training data. If the model only gener…
> But is it a flaw that the model encodes the world as it really is I want to be clear here, bias can be introduced at many different points. There's dataset bias, model bias, and training bias. Every model is biased. Every dataset is biased. Yes, the real world is also biased. But I want to make sure that there are ways to resolve this issue. It is terribly difficult, especially in a DL framework (even more so in a…
Sure, I wasn't questioning the bias of the data, I was talking about the bias of the real world and whether we want the model to be "unbiased about bias" i.e. metabiased or not.
Showing nurses equally as men and women is not biased, but it's metabiased, because the real world is biased. Whether metabias is right or not is more interesting than the question of whether bias is wrong because it's more subtle.
Disclaimer: I'm a fucking idiot and I have no idea what I'm talking about so take with a grain of salt.
Re: Imagen, a text-to-image diffusion model
#137Earlier quoted context omitted.
This raises some really interesting questions. We certainly don't want to perpetuate harmful stereotypes. But is it a flaw that the model encodes the world as it really is, statistically, rather than as we would like it to be? By this I mean that there are more light-skinned people in the west than dark, and there are more women nurses than men, which is reflected in the model's training data. If the model only gener…
It depends on whether you'd like the model to learn casual or correlative relationships. If you want the model to understand what a "nurse" actually is, then it shouldn't be associated with female. If you want the model to understand how the word "nurse" is usually used, without regard for what a "nurse" actually is, then associating it with female is fine. The issue with a correlative model is that it can easily be…
That’s a distinction without a difference. Meaning is use.
Re: Imagen, a text-to-image diffusion model
#138>While we leave an in-depth empirical analysis of social and cultural biases to future work, our small scale internal assessments reveal several limitations that guide our decision not to release our model at this time. Some of the reasoning: >Preliminary assessment also suggests Imagen encodes several social biases and stereotypes, including an overall bias towards generating images of people with lighter skin tones…
Genuinely, isn't it a prime example of the people actually stopping to think if they should, instead of being preoccupied with whether or not they could ?
Re: Imagen, a text-to-image diffusion model
#139Great. Now even if I do get a Dall-E 2 invite I'll still feel like I'm missing out!
It's always the same with AI research: "we have something amazing but you can't use it because it's too powerful and we think you are an idiot who cannot use your own judgement."
Dall-E had an entire news cycle (on tech-minded publications, that is) that showcased just how amazing it was.
Millions* of people became aware that technology like Dall-E exists, before anyone could get their hands on it and abuse it. (*a guestimate, but surely a close one)
One day soon, inevitably, everyone will have access to something 10x better than Imagen and Dall-E. So at least the public is slowly getting acclimated to it before the inevitable "theater-goers running from a projected image of a train approaching the camera" moment
Re: Imagen, a text-to-image diffusion model
#140Earlier quoted context omitted.
Translation: AI has the potential to transform society. When we release this model to the public it will be used in ways we haven’t anticipated. We know the model has bias and we need more time to consider releasing this to the public out of concerns that this transformative technology further perpetuate mistakes that we’ve made in our recent past.
> it will be used in ways we haven’t anticipated Oh yeah, as a woman who grew up in a Third World country, how an AI model generates images would have deeply affected my daily struggles! /s It's kinda insulting that they think that this would be insulting. Like "Oh no I asked the model to draw a doctor and it drew a male doctor, I guess there's no point in me pursuing medical studies" ...
> Oh no I asked the model to draw a doctor and it drew a male doctor, I guess there's no point in me pursuing medical studies
If you don't think this is a real thing that happens to children you're not thinking especially hard. It doesn't have to be common to be real.