Live data from Hacker News

Implementation of Imagen, Google's text-to-image neural network, in PyTorch

github.com

91–100 of 123 posts

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#91
Recent and related:

DALL-E 2 open source implementation - https://news.ycombinator.com/item?id=31228710 - May 2022 (152 comments)

Also:

X-Transformers: A fully-featured transformer with experimental features - https://news.ycombinator.com/item?id=27089208 - May 2021 (37 comments)

Text to Image Generation - https://news.ycombinator.com/item?id=26615791 - March 2021 (88 comments)

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#92
post #16

What is the reason Google published their research details about Imagen? Why don't they just keep their findings to themselfes and build products on top of them? Public companies can't do stuff just for the fun of it, right? So there must be some commercial reasoning behind it?

I think it is because the proprietary part for them is the data, not the particular algorithm. They benefit more from other people making advances on their technology because they have the data to get more benefit than anyone else. If they kept it to themselves, they would get no "free" advancement. So they trade-off the secret of the technique in the hope that others will advance the technique, making their data more valuable.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#93
post #90

Good to see LucidRains get the love he (rightly) deserves. He's a beast! As a thank you to him -- he also does for work for commission/etc, check hus GitHub page for more info. I'm not fiscally or currently otherwise directly linked to him too closely, I've just hung around a while and think he deserves far more credit than he gets. This is literally the smallest piece of the pie of what the man does across several s…

[deleted]

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#94
post #16

What is the reason Google published their research details about Imagen? Why don't they just keep their findings to themselfes and build products on top of them? Public companies can't do stuff just for the fun of it, right? So there must be some commercial reasoning behind it?

You realize this doesn't include the trained data, right?

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#95

Earlier quoted context omitted.

In some jurisdictions, deepfakes of any kind are treated as a form of defamation. In others, adult deepfakes specifically are illegal.

Which jurisdictions are those?

Korea. Hardcore pornography is also illegal there.

Keep in mind this is a country where if you leave a bad review after you get scammed by someone with evidence, it is defamation. So not quite leadership the world needs in this industry.

Really sad to see ppl on HN flagging all of my comments on this thread. I mean it's not like you can't find celebrity deepfakes including Kpop.

The cat is out of the bag and its only going to get better and faster from here whether some cultures/jurisdictions take offense or not.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#96

Earlier quoted context omitted.

Which is why porn is such a great dataset for crowdsource: - lots of people are stimulated by it - lots of people want DALL-E-2 for porn - and lots of people are willing to work towards that common goal The beauty of this is that people are just going to keep coming and coming to it. Like I'm trying to be mature and serious about this. What's it going to take? - Community responsible for scraping dataset, generating…

You are going to need to figure out how to filter out copyrighted works and images for which you don't have permission (eg, someone uploading a picture of an ex partner).

If its in public domain, there is no implicit right to privacy. It's going to be super difficult to claim derivative of copyrighted material going forward.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#97

Earlier quoted context omitted.

To run we must learn to walk first. To walk we must learn to be erect. To be erect we must master crawling. I don't think the leap is too crazy if we are talking short moving pictures without sound. However, when sound gets involved, this is where it would become very tricky.

"when sound gets involved, this is where it would become very tricky" I don't think a neural net would have much trouble generating moans in sync to the motion. Why pay humans for all that fake moaning when an AI could do it?

actually you are right, sound generation here wouldn't be as hard as I originally thought.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#98

Of course the implementation isn’t the issue. It’s the training data and the compute machines. Open source is pretty meaningless here

Images actually used our open LAION 400m dataset plus 400m of their own.

On compute there is more than enough compute available to open source now via LAION and Eleuther AI to train these models, will just a bit of time.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#99
post #90

Good to see LucidRains get the love he (rightly) deserves. He's a beast! As a thank you to him -- he also does for work for commission/etc, check hus GitHub page for more info. I'm not fiscally or currently otherwise directly linked to him too closely, I've just hung around a while and think he deserves far more credit than he gets. This is literally the smallest piece of the pie of what the man does across several s…

Second this, one of the biggest contributors to open source AI and someone everyone should sponsor.

Re: Implementation of Imagen, Google's text-to-image neural network, in PyTorch

#100

Earlier quoted context omitted.

Four or five figures I'd guess? I'm not clued up on costs/performance for TPU stuff to give a better estimate, but guessing at a week on a 256 TPU pod, call it $30k?

You are off by an order of magnitude at least. 256 TPUs-v4 (not pod), would cost you around 20k$/day. They actually used 512 TPUs (256 for base model + 128 for each of the two superresolution models). Assuming an average training time of 1 week as you said, that gives us about 280k$. It's also most likely trained for longer than a week, the base model for Dalle-2 was trained for 100-200k GPU hours, so between 2-4x lo…

Couldn't a bunch of us shell out $5000~$50,000 and do this ourselves? Create a non-profit shell corporation outside US jurisdiction, issue shares, raise funds and open source the result?

The shares would simply be votes towards future training dataset endeavors as no profit would be booked here. Say you buy 5000 out of 500,000 shares, that would give you 1% voting power in what dataset to train.

Post reply on HN