We see this same problem with face recognition software that says an innocent man's face matches a criminal. The cops just accept what the computer says and arrest people because the computer says it's a match.
We can't have the machine do stuff for us unless it's superior to human judgment, or the stakes are much lower than ruining lives.