Live data from Hacker News

YouTube now requires to label their realistic-looking videos made using AI

blog.google

371–380 of 517 posts

Re: YouTube now requires to label their realistic-looking videos made using AI

#371
It might take 50 years to awaken to the abuse of power going on here.

Forget individual videos for a second and look at youtube-the-experience as a whole. The recommendation stream is the single most important "generative AI" going on ever, using the sense of authenticity, curiosity and salience that comes from the individual videos themselves, but stitching them together in a very particular way. All the while the experience of being recommended videos being almost completely invisible. Of course this is psychologically "satisfying" to the users - in the shortest term - because they keep coming back, to the point of addiction. (Especially as features like shorts creep in).

Allowing the well of "interesting, warm, authentic audio & videos having the secondary gains of working on your psychological needs" being tainted with the question of generated content is a game changer because it breaks the wall of authenticity for the entire app. It brings the whole youtube-the-experience into question, it reduces its psychological stand-in function for human voice & likeness, band-aiding the hyper-individualized lonely person's suffering based content consumption habits. I know this is a bit dramatic, and for sure videos can be genuinely informative, but let's be honest, neither that is the entirety of your stream, nor that is the experience for the vast majority of the users. It will get worse as long as there is a mathematical headroom of making more money out of making it worse, that's what the shareholder duty is about.

When gen-AI came about I was naively happy about the fake "authenticity" wall of the recommended streams breaking down thanks to the garbage of generated sophistry overtaking and grossing out the users. Kind of like super delicious looking cakes turning out to be made of kitchen sponges turning people off of cakes all together. I was wrong to think AI oligopoly would let the opportunity of having a chokehold on the entire "content" business, and here we are. (Also this voluntary tagging will give them the perfect live training set, on top of what they have.)

Once the tech is good enough to generate video streams on the fly, so that all you need is a single livestream, that you won't even have a recommendation engine of videos and instead a team of virtual personas doing everything you could ever desire on screen, it is game over. It might already be game over.

To get out of this the single most important legislative maneuver is being able to accept and enforce the facts that a) recommendation is speech b) recommendation is also gen-AI, and should be subject to same level of regulatory scrutiny. I don't care if it generates pixels or characters at a time, or slaps together the most "interesting" subset of videos/posts/users/reels/shorts out of the vast sea of the collective content-consciousness, they are just one level of abstraction apart but functionally one and the same: look at me; look at my ads; come back to me; keep looking at me.

Re: YouTube now requires to label their realistic-looking videos made using AI

#372

Earlier quoted context omitted.

We have to expect people to think for themselves. People are flawed and will be deceived but trying to centralize critical thinking will have far more disastrous results. Its always been that way. Im not saying Youtube shouldn’t have AI labels. Im saying we shouldn’t assume they’re reliable.

>but trying to centralize critical thinking will have far more disastrous results No. Having sources of trust is the basis of managing complexity. When you turned the tap water on and bought a piece of meat at the butcher you didn't yourself verify whether its healthy right? You trust the medicine you buy contains exactly what is says on the label and didn't take a chemistry class. That's centralized trust. You rely…

I'm probably paraphrasing Schneier (and getting it wrong), but getting water from the tap and having it polluted or poisonous, has legal and criminal consequences. Similarly getting meat from a butcher and having it tainted.

Right now, getting videos which are completely AI/deepfaked to misrepresent, are not subject to the same consequences, simply because either #1 people can't be bothered, #2 are too busy spreading it via social media, or #3 have no idea how to sue the party on the other side.

And therein lies the danger, as with social media, of the lack of consequences (and hence the popularity of swatting, pretexting etc)

Re: YouTube now requires to label their realistic-looking videos made using AI

#373

Looks like there is a huge grea area that they need to figure out in practice. From https://support.google.com/youtube/answer/14328491# : Examples of content creators don’t have to disclose: * Someone riding a unicorn through a fantastical world * Green screen used to depict someone floating in space * Color adjustment or lighting filters * Special effects filters, like adding background blur or vintage effects * Pro…

  * Digitally altering audio to make it sound as if a popular singer missed a note in their live performance
Does all the autotuning that singers use in live performance counts?

/j

Re: YouTube now requires to label their realistic-looking videos made using AI

#376
post #45

Earlier quoted context omitted.

One black hat thing I'm curious about though is whether or not this tag can be weaponized. If I upload a real event and tag it as AI, will it reduce user trust that the real event ever happened?

I fear that we're barrelling fast toward a future when nobody can trust anything at all anymore, label or not.

It just goes back to trusting the source. If 5 media orgs post different recordings of the same political speech, you can be reasonably sure it actually happened, or at least several orders of magnitude more sure than if it's one blurry video from a no name account.

Re: YouTube now requires to label their realistic-looking videos made using AI

#377
post #362
post #317

Earlier quoted context omitted.

How does the signature help? It only proves that the video hasn't been altered since [timestamp]. It doesn't prove that it wasn't AI-generated or manipulated.

If I have a CCTV camera that is in a known location and a TPM that signs its footage, I could probably convince a jury that it’s legit in the face of a deepfake defense. That’s the bar- it’s not going to be infallible but if you don’t find evidence of tampering with the hardware then it’s probably going to be fine.

This might be worse than nothing. It's exactly the same tech as DRM, which is good enough to stop the average person, but where tons of people have private exploits stashed away to crack it. So the judge and general public trust the system to be basically foolproof, while criminals can forge fake signatures using keys they extracted from the hardware.

Re: YouTube now requires to label their realistic-looking videos made using AI

#378

AI that is indistinguishable from reality is a certainty for the not-so-distant future. That future will come, and it will come sooner than anyone's expecting. Yet all I see is society trying to prevent the inevitable from installing itself (because it's "scary", "dangerous", "undermines the very pillars of society" etc.), instead of preparing itself for when the inevitable occurs. People seem to have finally accepte…

> All I see is a meteor approaching and everyone trying to divert it, but no one actually preparing for when it does hit. Each day that passes I'm more certain that we will we look at each other like fools, asking ourselves "why didn't we focus on preparing for change, instead of trying to prevent change"?

I don't know, we've done a pretty good job at preventing nuclear war so far. We didn't just say "oh well, the genie is out of the bottle now. Everyone will have nuclear weapons soon and there's nothing we can do about it. All wars from now on are going to be nuclear. Might as well start preparing for nuclear winter." We signed treaties and made laws and used force to prevent us all from killing each other.

Re: YouTube now requires to label their realistic-looking videos made using AI

#379
post #298

Earlier quoted context omitted.

> It isn't an error, either. It's doing exactly what it's intended to, exactly as it's intended to do it. If the output is incorrect, that's error. It may not be a bug, but it is still error.

Calling it an error implies the model should be expected to be correct, the way a calculator should be expected to be correct. It generates syntactically correct language, and that's all it does. There is no "calculation" involved, so the concept of an "error" is meaningless - the sentences it creates either only happen to correlate to truth, or not, but it's coincidence either way.

That's one hell of a coincidence if it just "happens" to write syntactically correct code that does what the user asked, for example.

Re: YouTube now requires to label their realistic-looking videos made using AI

#380
post #367
post #37

I think it's smart to start trying things here. This has infinite flaws with it, but from a business and learnings standpoint it's a step toward the right direction. Over time we're going to both learn and decide what is and isn't important to designate as "AI" - Google's approach here at least breaks this into rules of what "AI" things are important to label: • Makes a real person appear to say or do something they…

I think it also gives them a legal / business remedy if people fail to label their content. If someone for example makes a political video and fails to label it, they can delete the video/terminate the account for a breach of service.

Given the regular stories posted on HN about folks who've had some aspect of their social or other media canceled by any some SaaS company, are these companies having many (legal) qualms as it is about canceling people without providing a good reason for it? Would be nice if they did, though...
Post reply on HN