Earlier quoted context omitted.
"Reality" as defined by the available training set isn't necessarily reality. For example, Google's image search results pre-tweaking had some interesting thoughts on what constitutes a professional hairstyle, and that searches for "men" and "women" should only return light-skinned people: https://www.theguardian.com/technology/2016/apr/08/does-goog... Does that reflect reality? No. (I suspect there are also mostly u…
If your query was about hairstyle, why do you even look or care about the skin color ? Nowhere there is any precision for a preferred skin color in the query of th user. So it sorts and gives the most average examples based on the examples that were found on the internet. Essentially answering the query "SELECT * FROM `non-professional hairstyles` ORDER BY score DESC LIMIT 10". It's like if you search on Google "best…
It's a simple case of sample bias.