To be clear I'm not making any statements about the creator, I imagine this is a reflection of the dataset: but the fact that there are so many categories for east Asian (Chinese, Japanese, Korean, and I hazard that the "Asian" tag would probably mostly generate east Asians) says volumes about the sexualizing gaze cast on Asian women. While certainly there's an ethical argument over such an algorithm (both for and ag…
You raise some very interesting points. For me this also demonstrates how deeply rooted, historical bias and prejudice bleeds through to this technology and could become a perpetuating factor. These models will reflect societal values, for better or worse. But also what will the next model, and successive models, that are trained on data from AI generate images, be like? It seems you could get an amplified or skewed…
That said, it might be too early to speculate on models trained on the outputs of other models. This algorithm seems to benefit greatly from the post-DALLE 2 art-gen renaissance, but still has a number of oddities and uncanny outputs (noted in the rest of this thread) that I imagine are nearly unavoidable given how familiar the human form is. But certainly, if such decisions end up amplified in later work, or through widespread usage, then the consequences are more significant than, say, simply reflecting uncritically a skewed data set.