Live data from Hacker News

People are trying to claim real videos are deepfakes

text.npr.org

161–170 of 200 posts

Re: People are trying to claim real videos are deepfakes

#161

Earlier quoted context omitted.

> On topic though, this doesn't make "It could be fake," a reasonable defense. Why not? If you go into court claiming you have a contract with someone but you have nothing notarized or even signed, you're the one who has to provide evidence of your claim. A video is no longer sufficient to do that because any plaintiff or internet troll now has the ability to convincingly fabricate one. It's no more proof of anything…

The difference is the difference between "it may be fake" and "it is fake". "May" being the key word that makes it a meaningless observation instead of a defense. If someone wants to defend themselves against video evidence, they need to say that it's fake, and create reasonable doubt about its veracity. You don't do that with "maybe" or "could be". > Why should it be the defendants who have to pay for the expert ins…

Your distinction doesn't make any sense.

Suppose the video isn't of an old statement made by the defendant which they don't remember making, it's a video of one of their products catching fire sourced from an anonymous YouTube account. They have no way to know if that video is fake or not, so on what basis could they claim to know for sure that it is?

But because it could very plausibly be fake, they should be able to demand proof that it isn't from the party trying to introduce it as evidence. For example, by having it authenticated by the person who created it, whose credibility could then be questioned etc.

> "That's not me, I wasn't at X, I was at Y, and here are receipts and witnesses" are highly likely to work too. Basically, an alibi.

An alibi is the defense proving that they couldn't have done it. The burden of proof is supposed to be on the plaintiff. Creating deepfakes is so easy that a plaintiff in possession of one by itself proves nothing.

Re: People are trying to claim real videos are deepfakes

#162

Earlier quoted context omitted.

> What if he thinks it could be fake, and doesn't know? He will be asked to justify that belief, and that justification will be weighed against the provenance of the video. That he's not saying that is telling; claiming the video is faked would likely hurt his credibility given the number of times he's provably made statements of this kind. > They should have to prove their claims. They have submitted it as evidence.…

> He will be asked to justify that belief Why? His lawyers could provide the same justification: Convincing deepfakes are easily produced at low cost by adversarial plaintiffs and internet trolls. > That he's not saying that is telling People are imperfect and if you misspeak under oath there are consequences. Testifying at all subjects you to cross-examination, which is time consuming and subjects you to lawyer tric…

> Why? His lawyers could provide the same justification: Convincing deepfakes are easily produced at low cost by adversarial plaintiffs and internet trolls.

Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system.

> Testifying at all subjects you to cross-examination, which is time consuming and subjects you to lawyer tricks by the other party. Not wanting to do it is the default.

Yes. If you aren't willing to argue against a piece of evidence in a convincing fashion, you have to live with that decision. The jury gets to draw inference from "huh, they didn't say anything in response to that..."

> Demanding that the introducing party authenticate it should be table stakes at this point.

They'll introduce it with someone describing it something like this:

"This is a seven year old video hosted publicly on YouTube, on the channel of a long-standing reputable organization, of a live event hosted by well-known reporters, which received contemporary news coverage. The claims in the video made by Musk are of a similar nature to others he has demonstrably made."

That's sufficient. Musk's lawyers are free to object, if they've got a good argument against all of that. They're also welcome to try and convince the jury that Musk never made the claims. I suspect the plaintiffs will be able to find plenty of corroborating evidence should it come to that.

Re: People are trying to claim real videos are deepfakes

#163

Earlier quoted context omitted.

This seems like the main point - it's not that court won't accept a deepfake defense, but you would have to prove that it was faked, just like any other convincing evidence

Isn't this backwards in criminal court? Wouldn't the onus be on the prosecution to prove that the video was real? This sounds ridiculous since we lived most of our lives in the video-is-real era that has sort of been coming to an end. I recall the Kyle Rittenhouse trial had an interesting take on this where the defense asked to throw out upscaled video which contrary to every police procedural TV show is a lot like j…

> Isn't this backwards in criminal court? Wouldn't the onus be on the prosecution to prove that the video was real?

The judge is very much for the prosecution deposing Musk to ask him - under oath - if he can corroborate or dispute what's in the video. The defense was asking the videos to be thrown out entirely because they could be fake.

Re: People are trying to claim real videos are deepfakes

#164

Earlier quoted context omitted.

The difference is the difference between "it may be fake" and "it is fake". "May" being the key word that makes it a meaningless observation instead of a defense. If someone wants to defend themselves against video evidence, they need to say that it's fake, and create reasonable doubt about its veracity. You don't do that with "maybe" or "could be". > Why should it be the defendants who have to pay for the expert ins…

Your distinction doesn't make any sense. Suppose the video isn't of an old statement made by the defendant which they don't remember making, it's a video of one of their products catching fire sourced from an anonymous YouTube account. They have no way to know if that video is fake or not, so on what basis could they claim to know for sure that it is? But because it could very plausibly be fake, they should be able t…

"Affirmative defense" is a specific legal term. It means yes, I am guilty of but that's OK because .

As for the rest - you'll have more luck discussing the specifics with your lawyer at this point. Good luck and I hope you find what you need.

Re: People are trying to claim real videos are deepfakes

#165

Earlier quoted context omitted.

The onus on the prosecution/plaintiff is to prove the defense guilty at whatever standard of evidence is required for the case. Not to prove or disprove any claims about evidence. If the defense makes a claim about any piece of evidence, it is up to them to prove to the court's satisfaction that their claim is truthful.

In criminal court at least, evidence is only admitted based on a chain of custody. You're not supposed to enter random videos off YouTube into evidence - you can only enter a piece of video into evidence based on witness testimony about how the video was taken. As such, the question of deep-fakes should be relatively irrelevant to (criminal) courts. If a witness claims that a particular video was filmed on a particul…

> In criminal court at least, evidence is only admitted based on a chain of custody.

Prosecution has a freer reign during deposition and can play a video from Youtube[1] and ask the subject of the video if they were at the location at a specific date and time, and if the words are their own.

1. With the courts permission.

Re: People are trying to claim real videos are deepfakes

#166

Earlier quoted context omitted.

> He will be asked to justify that belief Why? His lawyers could provide the same justification: Convincing deepfakes are easily produced at low cost by adversarial plaintiffs and internet trolls. > That he's not saying that is telling People are imperfect and if you misspeak under oath there are consequences. Testifying at all subjects you to cross-examination, which is time consuming and subjects you to lawyer tric…

> Why? His lawyers could provide the same justification: Convincing deepfakes are easily produced at low cost by adversarial plaintiffs and internet trolls. Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system. > Testifying at all subjects you to cross-examination, which is time consuming an…

> Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system.

You're going to create a deepfake of witness testimony in front of a live jury? How does that work?

And it's not that you can't submit a video, it's that if you want to, you should have to go find the person who took the video and have them testify that what it shows is what actually happened. And have them be identified, so their credibility can be called into question, e.g. if it turns out they're a long-time antagonist of the defendant.

> Yes. If you aren't willing to argue against a piece of evidence in a convincing fashion, you have to live with that decision. The jury gets to draw inference from "huh, they didn't say anything in response to that..."

But they did have something to say in response to that: Deepfakes are cheap and easy to create. That's a general argument, not a claim about the facts of the case, so it doesn't require testimony to substantiate.

> "This is a seven year old video hosted publicly on YouTube, on the channel of a long-standing reputable organization, of a live event hosted by well-known reporters, which received contemporary news coverage. The claims in the video made by Musk are of a similar nature to others he has demonstrably made."

None of which proves that the video is real. At best it's evidence that it's a possible fake which is seven years old and was published by an established organization.

What they could do is find the reporter who did the interview and bring them in to testify that what the video depicts is what actually happened, if they have a better memory of it than Musk. Which they may very well be able to do. But the point is that they should have to.

Re: People are trying to claim real videos are deepfakes

#167

Earlier quoted context omitted.

> Why? His lawyers could provide the same justification: Convincing deepfakes are easily produced at low cost by adversarial plaintiffs and internet trolls. Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system. > Testifying at all subjects you to cross-examination, which is time consuming an…

> Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system. You're going to create a deepfake of witness testimony in front of a live jury? How does that work? And it's not that you can't submit a video, it's that if you want to, you should have to go find the person who took the video and have…

> You're going to create a deepfake of witness testimony in front of a live jury? How does that work?

Witness testimony is trivially fabricated. It happens all the time in court. The solution is to rebut it, not ban it.

> But they did have something to say in response to that: Deepfakes are cheap and easy to create.

That's not a reasonable response, any more than "I saw him shoot the person" can't be rebutted with a vague, hand-wavy "well sometimes people lie" by itself.

> None of which proves that the video is real. At best it's evidence that it's a possible fake which is seven years old and was published by an established organization.

I don't think you're arguing in good faith.

Re: People are trying to claim real videos are deepfakes

#168
post #115

Essentially all evidence in court is assumed to be inadmissible (potentially fake) until a "foundation" is laid by the party who wishes to use it as an exhibit at trial. I can't just turn up with a random photo or video and ask the court to accept it. Generally this is done by having the person that created the media swear under oath. In the case of a photograph you would have the photographer on the stand and ask th…

Please, go on :) What is the process like in practice, and what are its weaknesses? How do you think this process will have to change to account for the ease of fabricating digital evidence?

OK, first thing to remember is that in most trials the lawyers for both parties probably know each other and the judge professionally, and often personally, depending a lot on the size of the courthouse/venue (technical term for the geographical area the court hears cases from). This is important because all three sides, plaintiff, defendant, and court (judge) want to make their life as simple as possible. In practice this means that before trial the judge will ask everyone to sort out the foundation before trial so that things can go quickly and in the case of a jury trial the jury's precious time isn't wasted on technical matters (as generally the jury isn't allowed to have an opinion on whether a piece of evidence is real - that is a matter solely for a judge to rule on).

What actually happens though, for the most part, is that none of the lawyers want to waste the time of a photographer to come into court to spend two seconds to say "yes" when asked if these are the photos they took. (Getting any witness into court is a nightmare). So the parties agree to "stipulate" the foundation of exhibits. So if the prosecutor asks to introduce a crime scene photo the defense lawyer will accept a stipulation that the photographer would swear to the images. This might buy the defense lawyer some brownie points as it saves the prosecution a lot of grunt work. The judge will also look on it favorably too, so more points there.

What is sad is that a lot of cases can be won on foundational grounds if lawyers stop stipulating to make things easier. There are many ways for foundation to fail and lawyers should require foundation to be proven on all but the most infallible cases.

One big issue coming through courts is child pornography. In many jurisdictions CSAM is legal if no real minors are involved in its production. To prove an image contains a real minor you either need the photographer (!) to vouch for it, or someone else that can verify the contents (e.g. the victim).

There are many other technical pieces to foundation that I could spend hours on. For instance, recorded security cam footage has no "photographer" so it is validated by swearing all the equipment was working fine.

The actual court Rules of Evidence for this process are really tiny, and practically all of the determinations are actually made based not on the wording of the rules but from the millions of pages of opinions of appeal court judges (case law) that has been written on this subject over the last few hundred years.

Re: People are trying to claim real videos are deepfakes

#169

Earlier quoted context omitted.

The way I've seen this work is that the Judge throws that in with 17 other bullshit arguments. And unless you can take a thorough and comprehensive swipe at all eighteen, which takes about 160 pages of filings, then your odds of even being heard on appeal are small. Something like 90% of appeals that do get heard lose anyway. This all costs a lot of money when lawyers cost $150 - $700 per hour. Expert testimony costs…

Could you provide a reference to proceedings that went this way, where the evidence was rejected and the case ultimately dropped as a result?

OJ's bloody glove is probably the most famous example.

Bill Cosby's case was also very famous, and recent. Only one victim was allowed to testify - inexplicable.

The very recent Donziger case was pretty shocking; some major evidence was ignored there, along with established procedures.

Then you have things going on at even higher levels, like the Supreme Court deciding not to investigate itself, or the CFR blocking witnesses that would have said the WMD story was baloney.

Those were cases where the entire world was watching. Imagine what goes on where it's only a million or two at stake.

Re: People are trying to claim real videos are deepfakes

#170

Earlier quoted context omitted.

> Cool. Video evidence, written evidence, witness testimony, and essentially everything else is now off the table. Congratulations; you've gotten rid of the entire trial court system. You're going to create a deepfake of witness testimony in front of a live jury? How does that work? And it's not that you can't submit a video, it's that if you want to, you should have to go find the person who took the video and have…

> You're going to create a deepfake of witness testimony in front of a live jury? How does that work? Witness testimony is trivially fabricated. It happens all the time in court. The solution is to rebut it, not ban it. > But they did have something to say in response to that: Deepfakes are cheap and easy to create. That's not a reasonable response, any more than "I saw him shoot the person" can't be rebutted with a…

> Witness testimony is trivially fabricated. It happens all the time in court. The solution is to rebut it, not ban it.

Witness testimony is under oath. You can lie, but then you can go to jail. And you can be cross-examined, unlike a video. The risk of punishment reduces the incentive to lie and the interactivity increases the potential for it to be discovered.

Witnesses also have varying credibility. If the witness is the plaintiff, they have an obvious incentive to lie and juries know that. Whereas a video from an unauthenticated source is no more credible but fosters the intuition that you're seeing something with your own eyes.

> I don't think you're arguing in good faith.

I think I am.

I think we can agree that a random video from a random YouTube channel has no credibility. But if you're going to stake the value of your evidence on the credibility of the source, you should at least have to establish that it can actually be authenticated by one of these credible parties and not just e.g. some syndicated clip that got published on their channel.

Which, once again, you may be able to do. But you should still have the burden of actually doing it.

Post reply on HN