Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Generate videos in Gemini and Whisk with Veo 2

blog.google

Post reply on HN
Print view View original

101–110 of 142 posts

Re: Generate videos in Gemini and Whisk with Veo 2

#101

Post by greesil »

barrenko wrote: post #26
tracerbulletx wrote: post #16

Earlier quoted context omitted.

Everyone keeps ignoring supply and demand when talking about the impacts of AI. Let's just assume it really gets so good you can do this and it doesn't suck. Yes the costs will get so low that there will be almost no barrier to making content but if there is no barrier to making content, the ROI will be massive, and so everyone will be doing it, you can more or less have the exact movie you want in your head on deman…

To quote Nikita Bier, never underestimate how many people just want to watch Netflix and die.

Am I the only one who can't stand Netflix's deluge of content? They occasionally had something good, but it's like once every two years.

Re: Generate videos in Gemini and Whisk with Veo 2

#103

Post by indexerror »

nodja wrote: post #56
torginus wrote: post #36

I am not really technical in this domain, but why is everything text-to-X? Wouldn't it be possible to draw a rough sketch of a terrain, drop a picture of the character, draw a 3D spline for the walk path, while having a traditional keyframe style editor, and give certain points some keyframe actions (like character A turns on his flashlight at frame 60) - in short, something that allows minute creative control just l…

Dataset. To train these models you need inputs and expected output. For text-image pairs there exists vast amounts of data (in the billions). The models are trained on text + noise to output a denoised image. The dataset of sketch-image pairs are significantly smaller, but you can finetune an already trained text->image model using the smaller dataset by replacing the noise with a sketch, or anything else really, but…

These datasets would definitely have a lot of Text => Sketch pairs as well. I wonder if its possible to extrapolate from Text => Sketch and Text => Image pairs to improve Sketch => Image capabilities. The models must be doing some notion of it already.

Re: Generate videos in Gemini and Whisk with Veo 2

#104

Post by fragmede »

cubefox wrote: post #46
minimaxir wrote: post #11

Whisk itself ( https://labs.google/fx/tools/whisk ) was released a few months ago under the radar as a demo for Imagen 3 and it's actually fun to play with and surprisingly robust given its particular implementation. It uses a prompt transmutation trick (convert the uploaded images into a textual description; can verify by viewing the description of the uploaded image) and the strength of Imagen 3's actually modern t…

> This tool isn’t available in your country yet > Enter your email to be notified when it becomes available (Submit) > We can't collect your emails at the moment

GDPR ftw!

Re: Generate videos in Gemini and Whisk with Veo 2

#105

Post by fragmede »

torginus wrote: post #36

I am not really technical in this domain, but why is everything text-to-X? Wouldn't it be possible to draw a rough sketch of a terrain, drop a picture of the character, draw a 3D spline for the walk path, while having a traditional keyframe style editor, and give certain points some keyframe actions (like character A turns on his flashlight at frame 60) - in short, something that allows minute creative control just l…

image-to-image speech-to-speech exists; yes almost everything is text-to, but there are exceptions

Re: Generate videos in Gemini and Whisk with Veo 2

#106

Post by patates »

fragmede wrote: post #104
cubefox wrote: post #46

Earlier quoted context omitted.

> This tool isn’t available in your country yet > Enter your email to be notified when it becomes available (Submit) > We can't collect your emails at the moment

GDPR ftw!

I'm not a lawyer but I thought GDPR didn't prevent that. It adds a lot of restrictions on how they can use those emails for how long, but not a complete ban on explicit sharing of emails.

Re: Generate videos in Gemini and Whisk with Veo 2

#107

Post by fragmede »

patates wrote: post #106
fragmede wrote: post #104

Earlier quoted context omitted.

GDPR ftw!

I'm not a lawyer but I thought GDPR didn't prevent that. It adds a lot of restrictions on how they can use those emails for how long, but not a complete ban on explicit sharing of emails.

If you read it very carefully, and then behave very carefully, you can comply with the law. Orrrrrr you can just not bother for your first pass, simply block the EU for now, and release it for them after you go and clean it up later.

Re: Generate videos in Gemini and Whisk with Veo 2

#108

Post by spyder »

torginus wrote: post #36

I am not really technical in this domain, but why is everything text-to-X? Wouldn't it be possible to draw a rough sketch of a terrain, drop a picture of the character, draw a 3D spline for the walk path, while having a traditional keyframe style editor, and give certain points some keyframe actions (like character A turns on his flashlight at frame 60) - in short, something that allows minute creative control just l…

Huh "everything text-to-X"? Most video gen AI has image-to-video option too either as a start or end frame or just as a reference for subjects and environment to include in the video. Some of them even has video-to-video options too, to restyle the visuals or reuse motions from the reference video.

Re: Generate videos in Gemini and Whisk with Veo 2

#110

Post by x-complexity »

gh0stcat wrote: post #33
jddj wrote: post #15

Earlier quoted context omitted.

I came to the same sort of conclusion when watching Kitsune, which I think was one person and VEO https://vimeo.com/1047370252 Granted, 5 minutes isn't 1h30 but it's not a million miles away either.

This actually so amateurish and cliche it's painful. The fact people like this shows that art never had a chance when the masses have no taste. This makes me depressed for artists and the future.

> This actually so amateurish and cliche it's painful. The fact people like this shows that art never had a chance when the masses have no taste. This makes me depressed for artists and the future.

This kind of rhetoric can best be summed up by one meme: "It's the children who are wrong"

Spouting off "unwashed masses" prose will only make people hate (snobs + critics + artists by proxy) more, if you're not willing to do your part and stop shooting down beginning attempts as "amateurish and cliche".

Actually say, **in words**, what directions & improvements can be made.

Post reply on HN