Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Imagen Video: high definition video generation with diffusion models

imagen.research.google

Post reply on HN
Print view View original

91–100 of 500 posts

Re: Imagen Video: high definition video generation with diffusion models

#91

Post by pyfork »

joshuahaglund wrote: post #40
naillo wrote: post #20

Earlier quoted context omitted.

Whatever insights and expertize you've gained up until now can probably be used to gain enough of a competitive advantage in this future industry to be employed. I doubt the people that will spend their time on this professionally will be former coders etc. (I've seen the stable diffusion outputs that coders will tweet. It's a good illustration that taste is still hugely important.)

I like your optimism but OP's job is to take text instructions and turn them into video, for advertisements. If Google (who already control so much of the advertising space) can take text instructions and turn them into advertisements, what's left for OP to do here? Even if there's some additional editing required this seems like it will greatly reduce the hours an editor is needed. And it can probably iterate option…

OP probably does more than it seems by interpreting what their client is asking for. Clients ask for some weird shit sometimes, and being able to parse the nonsense and get to the meat is where a lot of skill comes into play.

I think Cleo Abrams on YT recently tackled this exact question. She tried to generate art using DALL-E along with a professional artist, and after letting the public vote blindly, the pro artist clearly 'made' better content, even though they were both just typing into a text prompt.

Here's the link if you're interested: https://www.youtube.com/watch?v=NiJeB2NJy1A

I could see a lot of digital artists actually getting better at their job because of this, not getting totally displaced.

Re: Imagen Video: high definition video generation with diffusion models

#92

Post by yehAnd »

Keyframe wrote: post #53
kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

What happened to volume of web and graphic designers when templates+wordpress hit them?

We employed a bunch of people to enter data into a template.

Bit of an apples/oranges comparison to tech that will (eventually) generate endless supply of content with less effort than writing a Tweet.

The era of inventing layers of abstraction and indirection that simplify computer use down to structured data entry is coming to an end. A whole lot of IT jobs are not safe either. Ops is a lot of sending parameters over the wire to APIs for others to compute. Why hire them when “production EKS cluster” can output a TF template?

Re: Imagen Video: high definition video generation with diffusion models

#93

Post by inerte »

kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

It depends where you are in the industry.

If you're on the creative, storyboard, come up with ideas and marketing side, you will be fine.

If you're in actual production, booking sets, unfolding stairs to tape infinite background, picking up the best looking fruits in the grocery store... yeah, not looking good.

Go up in the value chain and learn marketing, how to tell stories, etc... you don't want to be approached by clients telling you what you should be doing, you want to be approached and being asked what the clients should be doing.

Re: Imagen Video: high definition video generation with diffusion models

#94

Post by llagerlof »

Apox wrote: post #34

I feel like in a not so far future, all this will be generalized into "generate new from all the existing". And at some point later, "all the existing" will be corrupted by the integrated "new" at it will all be chaos. I'm joking, it will be fun all along. :)

I definetely want more episodes of LOST. I would drop the infamous season 6 and generate more seasons following the 5th season.

Re: Imagen Video: high definition video generation with diffusion models

#95

Post by haxiomic »

jasonjamerson wrote: post #5

The most exciting thing about this to me is the possibility of doing photogrammetry from the frames and getting 3D assets. And then if we can do it all in real time...

This field is moving fast! Something like this has just been released. Checkout DreamFusion, which does something similar: They start with a random 3D NeRF field and use the same diffusion techniques to try to make it match the output of 2D image diffusion when viewed from random angles! Turns out it works shockingly well, and implies fully 3D representations are encoded in traditional 2D image generators

https://dreamfusion3d.github.io/

Re: Imagen Video: high definition video generation with diffusion models

#96

Post by adamsmith143 »

kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

Learn how to use these models is the easiest answer. Prompt Engineering (getting a model to output what you actually want) is going to be something of an art form and I would expect it to be in demand.

Re: Imagen Video: high definition video generation with diffusion models

#97

Post by bitL »

kranke155 wrote: post #37
jeffbee wrote: post #29

Earlier quoted context omitted.

When you animate a horse, does it have 5 legs with weird backwards joints? If not, your job is probably safe for now.

How long do you think until the horse looks perfect? 12 months? 5 years? I’m still 30 and I don’t see how my industry won’t be entirely disrupted by this within the next decade. And that’s my optimistic projection. It could be we have amazing output in 24 months.

It's not about random short clips - imagine introducing a character like Mickey Mouse and reusing him everywhere with the same character - my guess is it's going to take a while until "transfer" like that will work reliably.

Re: Imagen Video: high definition video generation with diffusion models

#98

Post by ijidak »

kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

It won't be easy. But below are my thoughts:

#1: Master these new tools #2: Build a workflow that incorporates these tools #3: Master storytelling #4: Master ad tracing and analytics #5: Get better at marketing yourself so that you stand out

The market for your skillset may shrink, but I doubt it will disappear...

Think about it this way...

Humans in cheaper countries are already much more capable than any AI we've built.

Yet, even now, There are practical limits on outsourcing.

It's hard for me to see how this will be much different for creative work.

It's one thing to casually look at images or videos, when there is no specific money-making ad in mind.

But as soon as someone is spending thousands to run an ad campaign, just taking whatever the AI spits out is unlikely to be the real workflow.

I guess I'm suggesting a more optimistic take...

View it as a tool to learn and incorporate in your workflow

I don't know if you gain much by stressing too much about being replaced.

And I'm not even sure that's reality.

I'm almost certain, most of the humans to lose their jobs will be people who either because of fear or stubbornness refuse to get better, refuse to incorporate these tools, and are thus unable to move up the value chain.

Re: Imagen Video: high definition video generation with diffusion models

#99

Post by odessacubbage »

kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

i really think it's going to take much longer than people think for this technology to go from 'pretty good' to actually being able to meet a production standard of quality with little to no human involvement. at this point, cleaning up after an ai is still probably more labor intensive than simply using the cheatcodes that already exist for quick and cheap realism. i expect in the midterm, diffusion models will largely exist in the same space as game engines like unity and unreal where it's relatively easy for an illiterate like me to stay within the rails and throw a bunch of premade assets together but getting beyond NINTENDO HIRE THIS MAN! and the stock 'look' of the engine still takes a great deal of expertise. >https://www.youtube.com/watch?v=C1Y_d_Lhp60

Re: Imagen Video: high definition video generation with diffusion models

#100

Post by victor9000 »

kranke155 wrote: post #15

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

Don't watch from the sidelines. Become adept at using these tools and use your experience to differentiate yourself from those entering the market.
Post reply on HN