It's an important development. Forensic labs and companies are expert witnesses with black box processes and the incentive to protect the authority of their profession. They are as likely to lie as any other witness. Perhaps even moreso. "Those arguing on behalf of the defense cited past problems with other genetic testing software such as STRmix and FST (Forensic Statistical Tool). Defense expert witnesses Mats Heim…
> a forensic pathologist was giving fake prosecution evidence The doctor handled thousands of cases in his career, and a well-funded inquiry found issues with less than 1% of them. Sure we'd like that to be 0%, and society should spend time thinking of how much they rely on complicated processes of reasoning, but that's a really good accuracy.
Accused murderer wins right to check source code of DNA testing kit
31–40 of 520 posts
Re: Accused murderer wins right to check source code of DNA testing kit
#32> Mark Perlin, is said to have argued against source code analysis by claiming that the program, consisting of 170,000 lines of MATLAB code, is so dense it would take eight and a half years to review at a rate of ten lines an hour. So it’s definitely riddled with bugs. And I can’t imagine that much matlab code following rigorous software engineering practices.
My exact thoughts. This sounds like a classic example of launching a prototype created by domain specialists (biostatisticians and bioinformaticians) as production software and skipping on the expensive stuff, like sound development practices
Re: Accused murderer wins right to check source code of DNA testing kit
#33Earlier quoted context omitted.
> Forensic labs and companies are expert witnesses with black box processes and the incentive to protect the authority of their profession. I imagine they're also incentivised to favour a result indicating guilt.
Why? The risk to their reputation & livelihood for a false positive should temper that.
Re: Accused murderer wins right to check source code of DNA testing kit
#34Wouldn't this set a precedent to eventually force any forensic software to become open source?
Which may well be a win as open source already has that.
However, even open source has bugs that pass scrutiny as many CVE's can attest, so whilst a code review may find nothing wrong, that in itself could be used by a lawyer to create reasonable doubt, if the lawyer is good.
Re: Accused murderer wins right to check source code of DNA testing kit
#35> Mark Perlin, is said to have argued against source code analysis by claiming that the program, consisting of 170,000 lines of MATLAB code, is so dense it would take eight and a half years to review at a rate of ten lines an hour. So it’s definitely riddled with bugs. And I can’t imagine that much matlab code following rigorous software engineering practices.
I also cant image anyone thinking that would be a winning legal argument... "This software is too complex to look at so just trust us" Really... that is what they went with...
Re: Accused murderer wins right to check source code of DNA testing kit
#36Earlier quoted context omitted.
> Forensic labs and companies are expert witnesses with black box processes and the incentive to protect the authority of their profession. I imagine they're also incentivised to favour a result indicating guilt.
Why? The risk to their reputation & livelihood for a false positive should temper that.
And if it comes to light, acknowledge a one-time error and carry on.
Re: Accused murderer wins right to check source code of DNA testing kit
#37Earlier quoted context omitted.
> Forensic labs and companies are expert witnesses with black box processes and the incentive to protect the authority of their profession. I imagine they're also incentivised to favour a result indicating guilt.
Why? The risk to their reputation & livelihood for a false positive should temper that.
Re: Accused murderer wins right to check source code of DNA testing kit
#38Earlier quoted context omitted.
> Forensic labs and companies are expert witnesses with black box processes and the incentive to protect the authority of their profession. I imagine they're also incentivised to favour a result indicating guilt.
Why? The risk to their reputation & livelihood for a false positive should temper that.
Re: Accused murderer wins right to check source code of DNA testing kit
#39Re: Accused murderer wins right to check source code of DNA testing kit
#40Earlier quoted context omitted.
> a forensic pathologist was giving fake prosecution evidence The doctor handled thousands of cases in his career, and a well-funded inquiry found issues with less than 1% of them. Sure we'd like that to be 0%, and society should spend time thinking of how much they rely on complicated processes of reasoning, but that's a really good accuracy.
You say that as if these were mistakes or unfortunate culminations of circumstance. The man committed fraud and sent innocent, grieving parents to prison by proxy. I don't think it's unreasonable to expect that to be 0.00% and punish those harshly who exceed that metric.