Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How Imagen Works

assemblyai.com

Post reply on HN
Print view View original

21–30 of 104 posts

Re: How Imagen Works

#21

Post by sailingparrot »

bpiche wrote: post #14
natch wrote: post #11

> Imagen, released just last month, can generate high-quality, high-resolution images given only a description of a scene “Released”? What? Papers are published. Websites are published. Tools are “released.” Where has Imagen been released?

This implementation popped up on hacker news not too long ago. I got it working on Colab first, and then my own GPU at home. But just barely. Need more memory :) https://github.com/lucidrains/imagen-pytorch

The value is in the data and the trained weights, the implementation is not where the bottleneck is in term of reproducing those models.

Still great work from the author though, but we most definitely cannot say that imagen is released.

Re: How Imagen Works

#22

Post by joshcryer »

refulgentis wrote: post #16
stavros wrote: post #15

Earlier quoted context omitted.

Wait, so I can try this on Colab right now?

No, something that's been causing a lotta confusion in AI art is people stand up quick implementations generally matching the general description in the paper, but, they're not really investing in training them. Then people see "imagen-pytorch" on GitHub and get confused, either think it's Imagen itself or a suitable replica of it. There's like 3 projects named DallE, and then the 2 real DallEs...frustrating.

People are really thirsty to play with this tech, you can't blame them. Just search for dataset creators on Hugging Face. I'd link directly to several of them running but it would just overwhelm the creators. If you want to be in early you'll find them. The beautiful thing is open source is going to make this stuff available for everyone and in very short timeframe. It's crazy how fast it moves.

Re: How Imagen Works

#23

Post by joshcryer »

Workaccount2 wrote: post #17

I have shown imagen (and dalle2) to a number of people now (non-tech, just everyday friends, family, co-workers) and I have been pretty stunned by the response I get from most people: "Meh, that's kinda cool? I guess?" or "What am I looking at?"..."Ok? So a computer made it? That seems neat" To me I am still trying to get my jaw off the floor from 2 months ago. But the responses have been so muted and shoulder shrugg…

I've made perhaps overly absolutist statements like "don't you see! this kills artists jobs!" and it was shrugged off as if I was insane. I probably could've phrased it differently, but to me this is game changing in several fields. Granted, it will open up a new field of "generative artists" but, having played with these things, this is a pretty trivial job, and their training nets are only going to get better.

Re: How Imagen Works

#24

Post by jazzyjackson »

Workaccount2 wrote: post #17

I have shown imagen (and dalle2) to a number of people now (non-tech, just everyday friends, family, co-workers) and I have been pretty stunned by the response I get from most people: "Meh, that's kinda cool? I guess?" or "What am I looking at?"..."Ok? So a computer made it? That seems neat" To me I am still trying to get my jaw off the floor from 2 months ago. But the responses have been so muted and shoulder shrugg…

I think if you've been paying attentiont to the space, this generation of image diffusion is shocking in how quickly it has improved on what we had a year ago.

But if you've never considered that a computer can produce an original image, this is just a new thing computers can do. OTOH I think it's also a lack of imagination in how useful this is, so far the output has been kind of random, so it seems a little gimmicky. Already "Parti" has gotten much closer to allowing a user to describe exactly what they want in the image, and as people start to see the use cases for them personally, it will hit them that they no longer have to hire someone, they can just type a request into a box.

Re: How Imagen Works

#25

Post by Uehreka »

joshcryer wrote: post #23
Workaccount2 wrote: post #17

I have shown imagen (and dalle2) to a number of people now (non-tech, just everyday friends, family, co-workers) and I have been pretty stunned by the response I get from most people: "Meh, that's kinda cool? I guess?" or "What am I looking at?"..."Ok? So a computer made it? That seems neat" To me I am still trying to get my jaw off the floor from 2 months ago. But the responses have been so muted and shoulder shrugg…

I've made perhaps overly absolutist statements like "don't you see! this kills artists jobs!" and it was shrugged off as if I was insane. I probably could've phrased it differently, but to me this is game changing in several fields. Granted, it will open up a new field of "generative artists" but, having played with these things, this is a pretty trivial job, and their training nets are only going to get better .

I’ve had a lot of fun playing with Disco Diffusion prompts, but I agree that the people excited about “a generation of prompt artists” are a bit misguided. Soon an AI will emerge that can come up with “better” prompts than you, and the “art” of creating prompts will have a lower skill ceiling.

Re: How Imagen Works

#26

Post by trention »

Workaccount2 wrote: post #17

I have shown imagen (and dalle2) to a number of people now (non-tech, just everyday friends, family, co-workers) and I have been pretty stunned by the response I get from most people: "Meh, that's kinda cool? I guess?" or "What am I looking at?"..."Ok? So a computer made it? That seems neat" To me I am still trying to get my jaw off the floor from 2 months ago. But the responses have been so muted and shoulder shrugg…

It's just an illustration of the fact that the average person doesn't give a sh*t about AI "art" and that it will have ~zero cost and ~zero value.

Re: How Imagen Works

#27

Post by [deleted] »

Uehreka wrote: post #25
joshcryer wrote: post #23

Earlier quoted context omitted.

I've made perhaps overly absolutist statements like "don't you see! this kills artists jobs!" and it was shrugged off as if I was insane. I probably could've phrased it differently, but to me this is game changing in several fields. Granted, it will open up a new field of "generative artists" but, having played with these things, this is a pretty trivial job, and their training nets are only going to get better .

I’ve had a lot of fun playing with Disco Diffusion prompts, but I agree that the people excited about “a generation of prompt artists” are a bit misguided. Soon an AI will emerge that can come up with “better” prompts than you, and the “art” of creating prompts will have a lower skill ceiling.

[deleted]

Re: How Imagen Works

#28

Post by russdill »

Uehreka wrote: post #25
joshcryer wrote: post #23

Earlier quoted context omitted.

I've made perhaps overly absolutist statements like "don't you see! this kills artists jobs!" and it was shrugged off as if I was insane. I probably could've phrased it differently, but to me this is game changing in several fields. Granted, it will open up a new field of "generative artists" but, having played with these things, this is a pretty trivial job, and their training nets are only going to get better .

I’ve had a lot of fun playing with Disco Diffusion prompts, but I agree that the people excited about “a generation of prompt artists” are a bit misguided. Soon an AI will emerge that can come up with “better” prompts than you, and the “art” of creating prompts will have a lower skill ceiling.

The GPT algorithms are actually pretty good at making detailed image generation prompts if you ask it to describe in detail the general idea you want.

Re: How Imagen Works

#29

Post by skinner_ »

> The central intuition in using T5 is that extremely large language models, by virtue of their sheer size alone, may still learn useful representations despite the fact that they are not explicitly trained with any text/image task in mind. [...] Therefore, the central question being addressed by this choice is whether or not a massive language model trained on a massive dataset independent of the task of image generation is a worthwhile trade-off for a non-specialized text encoder. The Imagen authors bet on the side of the large language model, and it is a bet that seems to pay off well.

The way out of this dilemma is to fine-tune T5 on the caption dataset instead of keeping it frozen. The paper notes that they don't do fine-tuning, but does not provide any ablation or other justification. I wonder if it would help or not.

Re: How Imagen Works

#30

Post by Wistar »

Workaccount2 wrote: post #17

I have shown imagen (and dalle2) to a number of people now (non-tech, just everyday friends, family, co-workers) and I have been pretty stunned by the response I get from most people: "Meh, that's kinda cool? I guess?" or "What am I looking at?"..."Ok? So a computer made it? That seems neat" To me I am still trying to get my jaw off the floor from 2 months ago. But the responses have been so muted and shoulder shrugg…

I haven't gotten such dismissive responses, but probably only because those I'm inclined to share such things with are the exact kinds of people who'd be blown away by them, and immediately grasp the significance.
Post reply on HN