Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Imagen Video: high definition video generation with diffusion models

imagen.research.google

Post reply on HN
Print view View original

331–340 of 500 posts

Re: Imagen Video: high definition video generation with diffusion models

#331

Post by Jaxkr »

amelius wrote: post #254
mkaic wrote: post #47

And there you have it. As an aspiring filmmaker and an AI researcher, I'm going to relish the next decade or so where my talents are still relevant. We're entering the golden age of art, where the AIs are just good enough to be used as tools to create more and more creative things, but not good enough yet to fully replace the artist. I'm excited for the golden age, and uncertain about what comes after it's over, but…

Don't worry. If you can place eyes, nose and mouth of a human in a correct relative position and thereby create a symmetric face that's not in the uncanny valley, you are still lightyears ahead of AI.

Have you tried the latest Stable Diffusion? Especially with GFP-GAN the faces can come out flawless.

I’d also take a peek at https://lexica.art/. Lots of very high quality output from SD.

Re: Imagen Video: high definition video generation with diffusion models

#332

Post by hackerlight »

monological wrote: post #36

What everyone is missing is that these AI image/video generators lack _taste_. These tools just regurgitate a mishmash of images from it's training set, without any "feeling". What you're going to tell me that you can train them to have feeling? It's never going to happen.

A Midjourney piece beat human artists in an art competition. So the judges of that competition disagree.

Re: Imagen Video: high definition video generation with diffusion models

#333

Post by azinman2 »

> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data. While our internal testing suggest much of explicit and violent content can be filtered out, there still exists social biases and stereotypes which are challenging to detect and filter. We have decided not to release the Imagen Video model or its source code until these concerns are mitigated.

The concerns cannot be mitigated. The cat's out of the bag. Russia has already used poor quality deep fakes in Ukraine to justify their war. This will only become bigger and bigger of an issue to the point where 'truth' is gone, nothing is trusted, and societies will continue to commit atrocities under false pretense.

Re: Imagen Video: high definition video generation with diffusion models

#334

Post by throwaway23597 »

jonas21 wrote: post #143
throwaway23597 wrote: post #113

Google continues to blow my mind with these models, but I think their ethics strategy is totally misguided and will result in them failing to capture this market. The original Google Search gave similarly never-before-seen capabilities to people, and you could use it for good or bad - Google did not seem to have any ethical concerns around, for example, letting children use their product and come across NSFW content…

It makes sense though. The biggest threat to Google right now isn't some scrappy startup eating their lunch. It's the looming regulatory action over antitrust and privacy that could weaken or destroy their core business. As this is a political problem (not a technical one), they don't want to do anything that could upset politicians or turn public opinion against them. Personally, I doubt they have serious ethical co…

Agh, I've thought this through and you're completely right. It's an interesting conundrum. Certainly releasing powerful tools into the wild runs a high risk of swaying public opinion in a negative direction. Given this I honestly wonder why Google continues to invest so much in AI at all. I imagine having automatically generated video ads and stuff would be cool, but would hardly move the needle on the core business enough to justify the massive investment they've made into AI. Not that I'm complaining about it though... Google's tech advances always seem to diffuse (heh) into the open source world, so at least we have that to look forward to.

Re: Imagen Video: high definition video generation with diffusion models

#335

Post by flycaliguy »

atty wrote: post #322
sbierwagen wrote: post #296

Earlier quoted context omitted.

>There is a clear risk from these sorts of models as they get better - I mean recreating specific individuals’ likenesses in compromising images And the risk behind that is...? If you drill down with such claims the core is always "someone might use this to lie online" and the proposed solution every single time is: more surveillance. End anonymity. Have a Facebook account required to use the internet. Real name and…

I strongly suspect you’ve never been on the end of an internet doxxing/hate brigade if you can’t imagine how this could be used to make someone’s life a living hell. I’ll explain again that I think they can be used for bad actions, and also that they should still be released, because the benefits will outweigh the negatives. It does not hurt to admit that some things can be dangerous when used in nefarious ways. No o…

I totally agree. People often argue that photoshop has been around forever and so on. Creating sophisticated pornographic video of any individual is brand new. Creating an app that realistically removes clothing from any photo is new technology.

I actually just now came up with an idea for a browser plug-in that removes clothing from every image loaded.

Re: Imagen Video: high definition video generation with diffusion models

#336

Post by Gigachad »

xor99 wrote: post #310
Gigachad wrote: post #293

Earlier quoted context omitted.

High definition is relative. Compared to the previous gen of AI videos, they are extremely crisp.

They look atrociously bad, if some future version of this produces high definition video then i'll be delighted. This seems like a clever but not useful shortcut to 3D. For now this goes in the could but couldn't pile.

Sure, but when you look at the last gen of videos, they looked like random blotchy noise with an almost distinguishable subject. These are quite clear and a human could likely guess the prompts used reasonably well. They are crap compared to real video but a remarkable improvement from AI video a month ago.

Re: Imagen Video: high definition video generation with diffusion models

#337

Post by Gigachad »

capitalsigma wrote: post #303
Gigachad wrote: post #297

Earlier quoted context omitted.

IMO facebook should stop "engagement based" recommendation engines until they have the ability to stop them being abused. Change the platform to show chronological posts from things users have subscribed to. They could perhaps have a curated selection of content that FB employees have screened to be good for general distribution. There is a world of difference between someone manually seeking out and subscribing to a…

That is definitely one opinion that you can hold about Facebook but it's unclear to me how it relates to this post about Google's new generative model

I don't think google is responsible for the content created any more than Windows is for running the program or your ISP is for serving it. Promotion and discovery are the places where moderation and responsibility come in.

Re: Imagen Video: high definition video generation with diffusion models

#338

Post by [deleted] »

alphabetting wrote: post #169
faeriechangling wrote: post #138

Earlier quoted context omitted.

I’ve heard a lot of “data is the new oil” talk and the inevitability of google’s dominance yet I’m inclined to agree with you. Stable diffusion was a big wakeup call where it was clear how much value freedom and creativity really had. The ethics problem is an artifact of googles model of trying to keep their AI under lock and key and carefully controlled and opaque to outsiders in how the sausage gets made and what i…

I agree the ethicist types are very lame but if they were trying to be opaque and obscure how the sausage is made I don't think they would have released as many AI papers they have over past decade. It also seems to me that imagen is way better than stable diffusion. They're not aiming for a product that caters to AI creatives. They aiming for tools that would benefit a 3B+ userbase.

[deleted]

Re: Imagen Video: high definition video generation with diffusion models

#339

Post by faeriechangling »

evouga wrote: post #201
faeriechangling wrote: post #138

Earlier quoted context omitted.

I’ve heard a lot of “data is the new oil” talk and the inevitability of google’s dominance yet I’m inclined to agree with you. Stable diffusion was a big wakeup call where it was clear how much value freedom and creativity really had. The ethics problem is an artifact of googles model of trying to keep their AI under lock and key and carefully controlled and opaque to outsiders in how the sausage gets made and what i…

> History will remember them as villains. Interesting analogy. Google, like the priests, is acting out of mix of good intentions (protecting the public from perceived dangers) and self-interest (maintaining secular power, vs. a competitive advantage in the AI space). In the case of the priests, time has shown that their good intentions were misguided. I have a pretty hard time believing that history will be as unkind…

The priests tried to protect the entire population from eternal damnation. They were fighting for higher stakes.

Re: Imagen Video: high definition video generation with diffusion models

#340

Post by hatenberg »

azinman2 wrote: post #333

> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data. While our internal testing suggest much of explicit and violent content can be filtered out, there still exists social biases and stereotypes which are challenging to detect and filter. We have decided not to release the Imagen Video model or its source code…

Someone shot someone with a cheap gun, the cat is out of the bag, gun regulation is pointless, let's let the assault rifles go free is the most american thing I've read all day.
Post reply on HN