Live data from Hacker News

FBI testimony on hair analysis contained errors in 90% of cases (2015)

fbi.gov

51–60 of 77 posts

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#51
post #40

Earlier quoted context omitted.

DNA has a fair amount more credibility than the others. While it's not the silver bullet people think it is, and it can be used to falsely incriminate someone, there is a scientifically supported method of showing two samples of DNA belong to the same person.

Maybe you know more about this than me, something that makes me uneasy about DNA evidence: Say you can confirm a sample is 100% a certain person. How do investigators have any idea how it got there? How do you know it’s from a criminal and not the guy that stocked the convenience store shelves? I tried to look into this and maybe I was searching the wrong thing but found nothing.

The relevant concept is called "chain of custody"; essentially you're trusting every person who ever handled the sample to have correctly documented where they got it and what they did with it.

This is the same way we guarantee the integrity of elections.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#52

Earlier quoted context omitted.

interesting - links?

https://archive.ph/DJGW7 There's a graphic about halfway down that shows supposed "evidence" of accelerants being used when in fact they're either common to all fires, caused by the rapid cooling from water used to extinguish the fire, or are simply random occurrences completely unrelated to the fire. Yet to this day they are taught to investigators as rock solid evidence of arson.

> Yet to this day they are taught to investigators as rock solid evidence of arson.

To be fair, any experiment investigating this could only show that they are evidence of arson. ;D

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#53

One of our clients at $Job is a testing laboratory for mold & asbestos samples - just from building inspectors & such. To maintain their modest accreditations, every single Analyst (person looking at submitted samples through a microscope) at that lab has to perform daily duplicates & replicates of their own & their coworkers' results (and achieve fairly demanding levels of consistency on those). Then they trade samp…

See, your job is to get accurate results because clients are paying to know if they have a problem or not. The FBI's job is to get convictions, so their lab's job is to create railroadable pseudo-evidence.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#54
post #23

So, if this is used in a trial where I am on the jury, I'll assume it implies a 90% chance the evidence says the defendant is innocent, plus a 5 to 9.9% chance of a false positive with the underlying test. Got it. Moving on. Edit: I was being snarky but, on reflection, if they are falling back on hair analysis, it implies they have a piece of the guilty party's hair and the defendant's hair, but are not willing to pr…

> I'll assume it implies a 90% chance the evidence says the defendant is innocent

Evidence isn't there to _prove_ anything, else we wouldn't need to ask anyone to be a juror. That's why we use "preponderance of evidence" and "beyond reasonable doubt" as our metric.

It also assumes that all juries, once they see bite mark analysis, presume it's magic then simply decide they're going to convict at that moment and shut off their brains for the rest of the trial. Do people really believe this is something that happens?

> A 99% probability of innocence is probably about right in that part of the criminal prosecution decision tree.

I find it very difficult to believe there's a single piece of evidence in a trial that could convince anyone of this. The totality of the evidence is what must be considered.

A single test tells you about a single sample in isolation with respect to it's time and method of collection. It doesn't definitely prove anything about an event, and I'm astonished that you could see it that way; unless you're operating under the presumption that all District Attorneys are corrupt to the point of no longer caring about justice and truth.

There are certainly examples of corruption, but to presume it's the norm to the extent that a single piece of evidence presented in a particular fashion would cause you to turn _your_ back on justice and truth as a matter of rote course.

How is that an improvement?

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#56

If you or I lie to the court, it is perjury. When it is the FBI, who are granted an additional level of professional authority and trust in their testimony 'because reasons' (even though no testimony should automatically be elevated over other) it's just harmless 'errors made in statements by FBI examiners' as phrased in this article. Having gone through the system, it's all lies. Let's start with plea agreements. Yo…

> Either a crime warrants a 5 year sentence, or a 15 year sentence

Then why is there a difference between first degree murder and second degree murder? Murder warrants a particular sentence, and circumstances should not matter?

> But sentencing is based not on your crime

The court is taking into consideration your behavior and your reticence over your own actions. Taking the plea deal shows reticence as it immediately requires an admission of guilt.

Demanding a trial, particularly when you actually have committed the offense, in an effort to "get out" of the time you must serve or to merely publish your side of the story is not viewed favorably by the court. Why should it be?

You're tying up immense resources simply to parse the details of your crime in an effort to convince a judge that maybe you're actually not that bad of a guy. The court knows it is not a perfect arbiter of the truth, and that it's application of process inherently deprives, in some way, the rights of everyone involved. Every witness you call is subpoenaed to court under penalty if they don't comply. Victims are never actually made whole by the trial, and offenders run the risk of incriminating themselves further.

They're there because they're necessary, not because they are an ideal or preferred solution. Courts aim for settlements in civil trials, and they aim for pleas in criminal trials.

> were considered unconstitutional up until the 60s when the police/judicial state started undermining constitutional rights.

The means under which they were offered was unconstitutional, why should it be against the constitution for you to negotiate your own settlement in a criminal matter with the state? Is it really a better outcome that you must go to trial without any option?

> even when it was complete garbage like lie detector tests.

Lie detector tests actually _do_ measure physiological responses, though. The problem is that's not all they measure, and the results are too polluted by the reviewer to be useful. That a human beings heart rate increases when they intentionally try to deceive another is an actual fact.

So are they really "complete garbage?" Or are they just not as pure of a datapoint as we thought they were? Perhaps this is why some courts still allow them to be admitted when all parties agree to it's use.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#57
post #40

Earlier quoted context omitted.

DNA has a fair amount more credibility than the others. While it's not the silver bullet people think it is, and it can be used to falsely incriminate someone, there is a scientifically supported method of showing two samples of DNA belong to the same person.

Maybe you know more about this than me, something that makes me uneasy about DNA evidence: Say you can confirm a sample is 100% a certain person. How do investigators have any idea how it got there? How do you know it’s from a criminal and not the guy that stocked the convenience store shelves? I tried to look into this and maybe I was searching the wrong thing but found nothing.

One catchphrase is "means, motive, opportunity". DNA can indicate a possible opportunity, in that a suspect's DNA can be shown to have appeared in the same place a crime occurred. That doesn't address means or motive, i.e. whether the suspect had the ability or inclination to commit the crime. If I were on a jury and a DNA sample was all the prosecution had, my verdict would be not guilty.

Keeping a massive DNA database and using it to convict someone, anyone because a crime occurred near something they touched before would be fallacious and unjust. However, if we already had other reasons to suspect someone, and DNA gives us another, that's much more powerful.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#58
post #34

Earlier quoted context omitted.

Firstly, I'm sorry you went through the system and had to face these kinds of issues. I generally agree with you. The fact some of these citizens people were likely incorrectly executed, and others died in prison, based on bad science makes this depressing to read. However, I would factor in intent and knowledge on the part of lab workers and experts when demanding penalties for their action. If they intentionally li…

It's the explicit job of prosecutors to get guilty verdicts regardless of the defendant's guilt. This is the core of the US's adversarial justice system. (In the same way it is the defense attorney's job to get a not guilty ruling.) I think this should be changed, so that false convictions are treated with the same level of seriousness as police officers shooting unarmed civilians on camera. Patterns of prosecutorial…

> It's the explicit job of prosecutors to get guilty verdicts regardless of the defendant's guilt.

This is not correct; they're supposed to e.g. dismiss charges if they learn they've charged the wrong guy.

The problem isn't that the system calls for them to convict innocent people. The problem is that they're evaluated by their conviction rate.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#59
post #53

One of our clients at $Job is a testing laboratory for mold & asbestos samples - just from building inspectors & such. To maintain their modest accreditations, every single Analyst (person looking at submitted samples through a microscope) at that lab has to perform daily duplicates & replicates of their own & their coworkers' results (and achieve fairly demanding levels of consistency on those). Then they trade samp…

See, your job is to get accurate results because clients are paying to know if they have a problem or not. The FBI's job is to get convictions, so their lab's job is to create railroadable pseudo-evidence.

Mold lawsuits are very common; the money in mold testing is to always find mold. People who honestly want to know whether they have a problem are dwarfed in number by people who honestly want a certificate that says mold was found.

Re: FBI testimony on hair analysis contained errors in 90% of cases (2015)

#60

If you or I lie to the court, it is perjury. When it is the FBI, who are granted an additional level of professional authority and trust in their testimony 'because reasons' (even though no testimony should automatically be elevated over other) it's just harmless 'errors made in statements by FBI examiners' as phrased in this article. Having gone through the system, it's all lies. Let's start with plea agreements. Yo…

> Either a crime warrants a 5 year sentence, or a 15 year sentence Then why is there a difference between first degree murder and second degree murder? Murder warrants a particular sentence, and circumstances should not matter? > But sentencing is based not on your crime The court is taking into consideration your behavior and your reticence over your own actions. Taking the plea deal shows reticence as it immediatel…

> Taking the plea deal shows reticence as it immediately requires an admission of guilt.

Or it shows a preference for 5 years over the risk of 15 years out of pure fear or knowledge that the jury will be manipulated with pseudo-scientific "evidence".

Taking a plea deal can be totally separate from guilt or innocence.

> You're tying up immense resources simply to parse the details of your crime in an effort to convince a judge that maybe you're actually not that bad of a guy.

You seem to be ignoring that someone may actually be innocent in some cases. You're sounding like an ambitious prosecutor yourself, or you just have too much faith that the system would never bring the wrong person to court.

> Courts aim for settlements in civil trials, and they aim for pleas in criminal trials.

Which, over time, turn into a perverse incentive structure because court time gets increasingly valued over justice and so plea deals become threats rather than offers.

Fundamentally, when presenting prosecutorial evidence that's not what it appears, my reaction, if I ever need to defend myself against such things, world be to further tie up the courts time by presenting evidence against the evidence and / or demanding a thorough explanation of the implications of what is being described as evidence. This could add literal weeks to every single case that goes to trial. The method of evidence collection would be on trial because there's so much trust lost due to, basically, lies on the part of law enforcement and prosecution in their pursuit of conviction as metric for success and promotion.

Post reply on HN