Live data from Hacker News

YouTube now requires to label their realistic-looking videos made using AI

blog.google

341–350 of 517 posts

Re: YouTube now requires to label their realistic-looking videos made using AI

#341
post #45

Earlier quoted context omitted.

One black hat thing I'm curious about though is whether or not this tag can be weaponized. If I upload a real event and tag it as AI, will it reduce user trust that the real event ever happened?

The AI tags are fundamentally useless. The premise is that it would prevent someone from misleading you by thinking that something happened when it didn't, but someone who wants to do that would just not tag it then. Which is where the real abuse comes in: You post footage of a real event and they say it was AI, and ban you for it etc., because what actually happened is politically inconvenient. And the only way to p…

> The AI tags are fundamentally useless.

To the extent that they allow Google to exclude AI video from training sets they’re obviously useful to Google.

Re: YouTube now requires to label their realistic-looking videos made using AI

#342
post #213

Earlier quoted context omitted.

The AI tags are fundamentally useless. The premise is that it would prevent someone from misleading you by thinking that something happened when it didn't, but someone who wants to do that would just not tag it then. Which is where the real abuse comes in: You post footage of a real event and they say it was AI, and ban you for it etc., because what actually happened is politically inconvenient. And the only way to p…

I think you have a bit backwards. If you want to publish pixels on a screen there should be no assumption that they represent real events. If you want to publish proof of an event, you should have some pixels on a screen along with some cryptographic signature from a device sensor that would necessitate atleast a big corporation like Nikon / Sony / etc. being "in on it" to fake. Also since no one likes RAW footage it…

So you could never edit the video?

Re: YouTube now requires to label their realistic-looking videos made using AI

#344

Earlier quoted context omitted.

I fear that we're barrelling fast toward a future when nobody can trust anything at all anymore, label or not.

We have to expect people to think for themselves. People are flawed and will be deceived but trying to centralize critical thinking will have far more disastrous results. Its always been that way. Im not saying Youtube shouldn’t have AI labels. Im saying we shouldn’t assume they’re reliable.

>but trying to centralize critical thinking will have far more disastrous results

No. Having sources of trust is the basis of managing complexity. When you turned the tap water on and bought a piece of meat at the butcher you didn't yourself verify whether its healthy right? You trust the medicine you buy contains exactly what is says on the label and didn't take a chemistry class. That's centralized trust. You rely on it ten thousand times a day implicitly.

There need to be measures to make sure media content is trustworthy, because the smartest person on the earth doesn't have enough resources to critically judge 1% of what they're exposed to every day. It is simply a question of information processing.

It's a mathematical necessity. Information that is collectively processed constantly goes up, individiual bandwith does not, therefore you need more division of labor, efficieny and higher forms of social organisation.

Re: YouTube now requires to label their realistic-looking videos made using AI

#345

Earlier quoted context omitted.

> If you want to publish proof of an event, you should have some pixels on a screen along with some cryptographic signature from a device sensor that would necessitate atleast a big corporation like Nikon / Sony / etc. being "in on it" to fake. At which point nobody could verify anything that happened with any existing camera, including all past events as of today and all future events captured with any existing came…

I think at minimum YouTube could tag existing footage uploaded before 2015 as very unlikely to be AI generated.

The first (acknowledged) deepfake video is from 1997

Re: YouTube now requires to label their realistic-looking videos made using AI

#347

Earlier quoted context omitted.

There's been a slow march to requiring hardware-backed security. I believe all new devices from the last couple of years need a TEE or a dedicated security chip. At least with Android there are too many OEMs and they screw up too often. Bad actors will specifically seek out these devices, even if they're not very technically skilled. The skilled bad actors will 0-day the devices with the weakest security. For politic…

But you don't have to ban them for this use case? You just need something opportunistic, not ironclad. An entity like Google could publish those devices' certificates as "we can't verify the integrity of these devices' cameras", and let the public deal with that information (or not) as they wish. Customers who care about proving integrity (e.g., the media) will seek the verifiable devices. Those who don't, won't. I c…

Woudln't that prevent most folks from being able to root their devices without making the camera lesser than everyone else's camera?

Re: YouTube now requires to label their realistic-looking videos made using AI

#348

Earlier quoted context omitted.

But you don't have to ban them for this use case? You just need something opportunistic, not ironclad. An entity like Google could publish those devices' certificates as "we can't verify the integrity of these devices' cameras", and let the public deal with that information (or not) as they wish. Customers who care about proving integrity (e.g., the media) will seek the verifiable devices. Those who don't, won't. I c…

Woudln't that prevent most folks from being able to root their devices without making the camera lesser than everyone else's camera?

What does this have to do with root? The camera chip would be the one signing the data flowing through it, not the Android kernel.

Re: YouTube now requires to label their realistic-looking videos made using AI

#349

Earlier quoted context omitted.

Basically, Google decides what’s real and what’s not. Cool.

Don't worry Google has become incompetent - it is in the "Fading AOL" portion of its life cycle. Do you remember how incontinent AOL became in the final minutes before it became completely irrelevant? Sure it's taking longer with Google. But it's not a process that they can reverse. That means the system will be really really awful. So challengers can arise - maybe a challenger that YOU build, and open source!

I think you're living in a bubble if you believe that.

Re: YouTube now requires to label their realistic-looking videos made using AI

#350
post #45

Earlier quoted context omitted.

One black hat thing I'm curious about though is whether or not this tag can be weaponized. If I upload a real event and tag it as AI, will it reduce user trust that the real event ever happened?

The AI tags are fundamentally useless. The premise is that it would prevent someone from misleading you by thinking that something happened when it didn't, but someone who wants to do that would just not tag it then. Which is where the real abuse comes in: You post footage of a real event and they say it was AI, and ban you for it etc., because what actually happened is politically inconvenient. And the only way to p…

AI tags are to cover issues in the other direction: you publish an event as real, but they can prove it wasn't. If you didn't put the tag on it, malice can be inferred from your post (and further legal proceeding/moderation can happen)

It's the same as paid reviews: tags and disclaimers exist to make it easier to handle cases where you intentionally didn't put them.

It's not perfect and can be abused in other ways, but at least it's something.

Post reply on HN