Live data from Hacker News

Semantics derived automatically from language corpora contain human-like biases

scim.ag

1–10 of 92 posts

Re: Semantics derived automatically from language corpora contain human-like biases

#2
Coauthor here. Some of the press articles about our work didn't have a lot of nuance (unsurprisingly), but in the paper we're careful about what we say, what we don't say, and what the implications are. Happy to engage in informed discussion :)

Re: Semantics derived automatically from language corpora contain human-like biases

#4

Coauthor here. Some of the press articles about our work didn't have a lot of nuance (unsurprisingly), but in the paper we're careful about what we say, what we don't say, and what the implications are. Happy to engage in informed discussion :)

very interesting topic - could you please share a link to the original paper.

best probably to read that one first.

Re: Semantics derived automatically from language corpora contain human-like biases

#6

Coauthor here. Some of the press articles about our work didn't have a lot of nuance (unsurprisingly), but in the paper we're careful about what we say, what we don't say, and what the implications are. Happy to engage in informed discussion :)

Can you provide an example of how this bias might play out in a human-AI interaction?

Re: Semantics derived automatically from language corpora contain human-like biases

#8
post #4

Coauthor here. Some of the press articles about our work didn't have a lot of nuance (unsurprisingly), but in the paper we're careful about what we say, what we don't say, and what the implications are. Happy to engage in informed discussion :)

very interesting topic - could you please share a link to the original paper. best probably to read that one first.

> very interesting topic - could you please share a link to the original paper.

Unless the link was changed in the few minutes since you posted your comment, the link for the article is the original Science paper (http://science.sciencemag.org/content/356/6334/183.full)

Re: Semantics derived automatically from language corpora contain human-like biases

#10

Coauthor here. Some of the press articles about our work didn't have a lot of nuance (unsurprisingly), but in the paper we're careful about what we say, what we don't say, and what the implications are. Happy to engage in informed discussion :)

Do you have any evidence that this effect results in machines making systematically wrong inferences?

Near as I can tell, your paper shows that these "biases" result in significantly more accurate predictions. For example, Fig 1 shows that a machine trained on human language can accurately predict the % female of many professions. Fig 2 shows the machine can accurately predict the gender of humans.

Normally I'd expect a "bias" to result in wrong predictions - but in this case (due to an unusual redefinition of "bias") the exact opposite seems to occur.

(Drawing on your analogy with stereotypes, it's probably also worth linking to a pointer on stereotype accuracy: http://emilkirkegaard.dk/en/wp-content/uploads/Jussim-et-al-... http://spsp.org/blog/stereotype-accuracy-response )

Post reply on HN