Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

realitydefender.com

Post reply on HN
Print view View original

11–20 of 70 posts

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#13

Post by asail77 »

taneq wrote: post #4

Yeah but does it actually work, though? There have been a lot of online tools claiming to be "AI detectors" and they all seem pretty unreliable. Can you talk us through what you look for, the most common failure modes and (at suitably high level) how you dealt with those?

Give it a try for yourself. It's free!

We have been working on this problem since 2020 and have created an trained an ensemble of AI detection models working together to tell you what is real and what is fake!

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#14

Post by Grimblewald »

I feel like a much easier solution is enforcing data provinence. Ssl for media hash, attach to metadata. The problem with AI isnt the fact its ai, its that people can invest little effort to sway things with undue leverage. A single person can look like 100's with signficantly less effort than previously. The problem with ai content is it makes abuse of public spaces much easier. Forcing people to take credit for work produced makes things easier (not solved) kind of like email. Being able to block media by domain would be a dream, but spam remains an issue.

so, tie content to domains. A domain vouches for content works like that content having been a webpage or email from said domain. Signed hash in metadata is backwards compatible and its easy to make browsers etc display warnings on unsigned content, content from new domains, blacklisted domains, etc.

benefit here is while we'll have more false negatives, unlike something like this tool, it does not cause real harm on false positives, which will be numerous if it wants to be better tham simply making someome accountable for media.

AI detection cannot work, will not work, and will cause more harm than it prevents. stuff like this is irresponsible and dangerous.

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#15

Post by bee_rider »

BananaaRepublik wrote: post #8

Won't this just become the fitness function for training future models?

Just based on the first post, where they talk about their API a bit, it sounds like a system hosted on their machines(?). So, I assume AI trainers won’t be able to run it locally, to train off it.

Although, I always get a bad smell from that sort of logic, because it feels vaguely similar to security through obscurity in the sense that it relies on the opposition now knowing what you are doing.

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#17

Post by primitivesuave »

First want to say that I sincerely appreciate you working on this problem. The proliferation of deepfakes is something that virtually every technology industry is dealing with right now.

Suppose that deepfake technology progressed to the point where it is still detectable by your technology, but is impossible for the naked eye. In that scenario (which many would call an eventuality), wouldn't you also be compelled to serve as an authoritative entity on the detection of deepfakes?

Imagine a future politician who is caught on video doing something scandalous, or a court case where someone is questioning the veracity of some video evidence. Are the creators of deepfake detection algorithms going to testify as expert witnesses, and how could they convince a human judge/jury that the output of their black box algorithm isn't a false positive?

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#18

Post by chrisweekly »

bee_rider wrote: post #15
BananaaRepublik wrote: post #8

Won't this just become the fitness function for training future models?

Just based on the first post, where they talk about their API a bit, it sounds like a system hosted on their machines(?). So, I assume AI trainers won’t be able to run it locally, to train off it. Although, I always get a bad smell from that sort of logic, because it feels vaguely similar to security through obscurity in the sense that it relies on the opposition now knowing what you are doing.

now -> not

Re: Launch HN: Reality Defender (YC W22) – API for Deepfake and GenAI Detection

#19

Post by bee_rider »

chrisweekly wrote: post #18
bee_rider wrote: post #15

Earlier quoted context omitted.

Just based on the first post, where they talk about their API a bit, it sounds like a system hosted on their machines(?). So, I assume AI trainers won’t be able to run it locally, to train off it. Although, I always get a bad smell from that sort of logic, because it feels vaguely similar to security through obscurity in the sense that it relies on the opposition now knowing what you are doing.

now -> not

True, haha. Although “the opposition now knowing what you are doing” is the big danger for this sort of scheme!
Post reply on HN