AI-Generated Voice Evidence Poses Dangers in Court
lawfaremedia.org
AI-Generated Voice Evidence Poses Dangers in Court
1–10 of 171 posts
Re: AI-Generated Voice Evidence Poses Dangers in Court
#2Sounds like reasonable changes.
Generally speaking, I think evidence tampering is not a new problem, and even though it's easy in some cases, I don't think it's _that_ widespread. Just like it's possible to lie on the stand, but people usually think twice before they do it, because _if_ they are found to have lied, they're in trouble.
My main concern is rather that legit evidence can now easily be called into question. That seems to me like a much higher risk than fake evidence, considering the overall dynamics.
But ultimately: Humanity has coped without photo, audio or video evidence for most of its existence. I suppose it will cope again.
Re: AI-Generated Voice Evidence Poses Dangers in Court
#3Sounds like reasonable changes. Generally speaking, I think evidence tampering is not a new problem, and even though it's easy in some cases, I don't think it's _that_ widespread. Just like it's possible to lie on the stand, but people usually think twice before they do it, because _if_ they are found to have lied, they're in trouble. My main concern is rather that legit evidence can now easily be called into questio…
I agree. The article didn't touch on this aspect, but we're now at the point where even authentic recordings could be plausibly denied and claimed to be fake. So the entire usage of recordings as evidence will suffer a hit. We may essentially be knocked back to an 18th century level of reliance on eyewitness testimony. One wonders what the consequences for justice will be.
Re: AI-Generated Voice Evidence Poses Dangers in Court
#4Sounds like reasonable changes. Generally speaking, I think evidence tampering is not a new problem, and even though it's easy in some cases, I don't think it's _that_ widespread. Just like it's possible to lie on the stand, but people usually think twice before they do it, because _if_ they are found to have lied, they're in trouble. My main concern is rather that legit evidence can now easily be called into questio…
[deleted]
Re: AI-Generated Voice Evidence Poses Dangers in Court
#5How is AI voice faking any different than any other type of faking? How is it different than a manipulated recording, or a recording where someone is imitating another?
It is just as easy to fake many paper documents, and we have accepted documents as evidence for centuries.
Photos can be faked, video can be edited or faked, witnesses lie or misremember.
Is this just about telling lawyers that unvetted audio recordings can be unreliable? Because that shouldn't be news.
Edit: this is a good faith question. I'm legitimately just curious. Splicing and editing have been around since recording was invented, I was legitimately curious why voice recordings would have been given extra evidential weight when manipulating recordings is a known possibility.
Re: AI-Generated Voice Evidence Poses Dangers in Court
#6Sounds like reasonable changes. Generally speaking, I think evidence tampering is not a new problem, and even though it's easy in some cases, I don't think it's _that_ widespread. Just like it's possible to lie on the stand, but people usually think twice before they do it, because _if_ they are found to have lied, they're in trouble. My main concern is rather that legit evidence can now easily be called into questio…
I agree. The article didn't touch on this aspect, but we're now at the point where even authentic recordings could be plausibly denied and claimed to be fake. So the entire usage of recordings as evidence will suffer a hit. We may essentially be knocked back to an 18th century level of reliance on eyewitness testimony. One wonders what the consequences for justice will be.
I wouldn't say we'd be quite back to pre-photo evidence days. I feel a lot if not most of the value in a video/audio recording is not just that the medium has traditionally been difficult to edit, but that it's attesting to a lot of details with high specificity. There's a lot to potentially get caught out on with not a lot of wiggle room when inconsistencies are spotted (compared to recalling from memory). Document scans and static images are still useful despite having long been trivial to edit, for instance.
Re: AI-Generated Voice Evidence Poses Dangers in Court
#7Wait some more time and photos or even video recordings will be deemed just as dangerous. And then what? Even if there is real evidence, it will have to be discarded unless it can't be sufficiently validated. It will get very hard to prove anything.
Re: AI-Generated Voice Evidence Poses Dangers in Court
#8How is AI voice faking any different than any other type of faking? How is it different than a manipulated recording, or a recording where someone is imitating another? It is just as easy to fake many paper documents, and we have accepted documents as evidence for centuries. Photos can be faked, video can be edited or faked, witnesses lie or misremember. Is this just about telling lawyers that unvetted audio recordin…
"We've had projectile murder for centuries with arrows, how are these machine guns and missiles any different?"
Re: AI-Generated Voice Evidence Poses Dangers in Court
#9[dead]
Re: AI-Generated Voice Evidence Poses Dangers in Court
#10How is AI voice faking any different than any other type of faking? How is it different than a manipulated recording, or a recording where someone is imitating another? It is just as easy to fake many paper documents, and we have accepted documents as evidence for centuries. Photos can be faked, video can be edited or faked, witnesses lie or misremember. Is this just about telling lawyers that unvetted audio recordin…
Presuming good faith here, faking recordings has been harder to do, easier to detect, and less equivocal in the past than it is now.
If it takes an FX house to generate a plausible recording of me saying something I didn't say, that's a risky enterprise with a lot of witnesses.
If my enemy can do it in their basement with an hour of research, the exposure risk goes way down, and consequently the expectation you'll see it in real life goes way up.