Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dall-E 2

openai.com

Post reply on HN
Print view View original

351–360 of 511 posts

Re: Dall-E 2

#351

Post by drusepth »

sillysaurusx wrote: post #194
andreyk wrote: post #17

Earlier quoted context omitted.

I would caution that artwork is only 'solved' with relatively simple text prompts. To create a novel painting with a precise mix of elements that would take a paragraph or more to explain is still tough, though DALL-E 2 does seem like a big step towards that.

Sam seems to be demoing something fairly close on twitter. https://twitter.com/sama/status/1511724264629678084 The solar powered ship with a propeller sailing under the golden gate bridge during sunset with dolphins jumping around was pretty impressive. https://twitter.com/sama/status/1511731259319349251 I think it's only missing the dolphins.

It should be noted that most "AI-generated" images shared (Sam's included here) are typically just a first pass, whereas most recent models also include some kind of inpainting method, where you can then mask off various parts of an image and continue to edit those specific areas until the whole image is what you're looking for. This process makes it feel a lot more like a "tool" used by artists than a simple magic box that just gives you an "art piece" and you're done.

As a tool, this could be used by an artist to continue working on that image until it's exactly what the artist (or the comissioner) is looking for: masking off the water to actually add dolphins, masking off the ship to redraw it, retoning the sky for a more aesthetically-pleasing sunset, adding other objects to specific locations in the scene, etc.

Here's one example of how these composite prompts + masking can make more specific images here: https://twitter.com/jmhessel/status/1511757848442654721

Re: Dall-E 2

#352

Post by uoaei »

qq66 wrote: post #247
recuter wrote: post #73

Earlier quoted context omitted.

What always bother me with this stuff is, well, you say one approach is more sensible than the other because the images happen to come out more pleasing. But there's no real rhyme or reason, it is a sort of alchemy. Is text encoding strictly worse or is it an artifact of the implementation? And if it is strictly worse, which is probably the case, why specifically? What is actually going on here? I can't argue that th…

I think deep learning is better thought of as "science" than "engineering." Right now we're in the stage of the Greeks and Arabs where we know "if we do this then that happens." It will be awhile before we have a coherent model of it, and I don't think we will ever solve all of its mysteries.

We are getting closer with variational methods and kernel methods to achieving a more holistic framework for understanding machine learning (incl. traditional deep learning) training and inference. There is a deep unity in the fundamentals of machine learning, formed into a cohesive whole by applying the analytical techniques of statistical mechanics and Bayesian probability theory.

Re: Dall-E 2

#353

Post by uoaei »

falcor84 wrote: post #246

>We’ve limited the ability for DALL·E 2 to generate ... adult images. I think that using something like this for porn could potentially offer the biggest benefit to society. So much has been said about how this industry exploits young and vulnerable models. Cheap autogenerated images (and in the future videos) would pretty much remove the demand for human models and eliminate the related suffering, no? EDIT: typo

No.

If people are exposed to stimuli, they will pursue increasingly stimulating versions of it. I.e., if they see artificial CP, they will often begin to become desensitized (habituated) and pursue real CP or even live children thereafter.

Conversely, if people are not exposed to certain stimuli, they will never be able to conceptualize them, and thus will be unable to think about them.

Obviously you cannot eliminate all CP but minimizing the overall levels of exposure / ease of access to these kinds of things is way more appropriate than maximizing it.

Re: Dall-E 2

#354

Post by mgdlbp »

sillysaurusx wrote: post #262
falcor84 wrote: post #246

>We’ve limited the ability for DALL·E 2 to generate ... adult images. I think that using something like this for porn could potentially offer the biggest benefit to society. So much has been said about how this industry exploits young and vulnerable models. Cheap autogenerated images (and in the future videos) would pretty much remove the demand for human models and eliminate the related suffering, no? EDIT: typo

Depends whether you think models should be able to generate cp. It's almost impossible to even give an affirmative answer to that question without making yourself a target. And as much as I err on the side of creator freedom, I find myself shying away from saying yes without qualifications. And if you don't allow cp, then by definition you require some censoring. At that point it's just a matter of where you censor,…

I've thought for quite some time that questionable AI-generated content will lie at the heart of an forthcoming 'Infocalypse'. [0] Given the 2021 AI Dungeon fiasco over text-based AI-generated child porn, I shall posit that it's already upon us.

30 years since the original issue of encryption, it looks like cp trumps the other Horsemen of the Cyperpunk FAQ, with drug dealers and organized crime taking the back seat. It's interesting how misinformation is a recent development that they anticipate; a Google search shows that the term 'Infocalypse' was actually appropriated by discussions of deepfakes some time in mid-2020. That said, the crypto wars are here to stay—most recently with EARN IT reintroduced just two months ago.

The similar issue of 3D-printed guns has developed in parallel over the past decade as democratized manufacturing became a reality. There are even HN discussions tying all of these technologies together, by comparing attitudes towards the availability of Tor vs guns (e.g., [1]).

And there are innumerable related moral qualms to be had in the future; will the illegal drugs or weapons produced using matter replicators be AI-designed?

Overall, I think all of these issues revolve around the question of what it means to limit freedoms that we've only just invented, as technological advances enable things never before considered possible in legislation. (And as the parent comment implies, here's where the use of science fiction in considering the implications of the impossible comes in).

[0] https://en.wikipedia.org/wiki/Four_Horsemen_of_the_Infocalyp...

[1] https://news.ycombinator.com/item?id=8816013

Re: Dall-E 2

#355

Post by astrange »

andybak wrote: post #207
recuter wrote: post #165

Earlier quoted context omitted.

https://cdn.openai.com/papers/dall-e-2.pdf > Given an image x, we can obtain its CLIP image embedding zi and then use our decoder to “invert” zi, producing new images that we call variations of our input. .. It is also possible to combine two images for variations. To do so, we perform spherical interpolation of their CLIP embeddings zi and zj to obtain intermediate zθ = slerp(zi, zj , θ), and produce variations of z…

I'm not sure that's "compositing" except in the most abstract sense? But maybe that's the sense in which you mean it. I'd argue that at no point is there a representation of a "teddy bear" and "a background" that map closely to their visual representation - that are combined. (I'm aware I'm being imprecise so give me some leeway here)

This model's predecessor could do image editing with some help:

https://arxiv.org/pdf/2112.10741.pdf

so it could distinguish individual objects from backgrounds. Other ML models can definitely do that; it's called "panoptic segmentation".

Re: Dall-E 2

#356

Post by astrange »

Imnimo wrote: post #197
johnfn wrote: post #157

Earlier quoted context omitted.

I gotta be missing something here, because wasn’t “teaching a three year old to paint” (where the three year old is DALLE) the original objective in the first place? So if we’ve reduced the problem to that, it seems we’re back where we started. What’s the difference?

I meant to say that Dall-E 2's approach is closer to "teaching a three year old to paint" than the alternative methods. Instead of trying to maximize agreement to a text embedding like other methods, Dall-E 2 first predicts an image embedding (very roughly analogous to envisioning what you're going to draw before you start laying down paint), and then the decoder knows how to go from an embedding to an image (very ro…

Well, original DALL-E also worked this way. The reason the open source models use searches is that OpenAI didn't release DALL-E, but only another project called CLIP they used to sort DALL-E output by quality. It turns out CLIP could be adapted to produce images too if you used it to drive a GAN.

There is a DALL-E model available now from another company and you can use it directly (mini-DALLE or ruDALL-E), but its vocabulary is small and it can't do faces for privacy reasons.

Re: Dall-E 2

#357

Post by btmiller »

0F wrote: post #281
dntrkv wrote: post #229

Earlier quoted context omitted.

I don't think anyone is in denial about this, it's just not something anyone should concern themselves with in the foreseeable future. AI that can replace a dev or designer is nowhere close to becoming a reality. Just because we have some cool demos that show some impressive capabilities in a narrow application does not mean we can extrapolate that capability to something that is many times more complex.

I strongly and emphatically disagree. You frame it like we invented these AIs. Did we write the algorithms that actually run when it’s producing its output? Of course not, we can’t understand them let alone write them. We just sift around until we find them. So obviously the situations lends its self to surprises. Every other year we get surprised by things that all the “experts” said was 50 years off or impossible,…

This comment settles it for me. You’re thoroughly way too hyperbolic in your assessment. If this was closer to reality you’d have been able to state your case in clear, realistic terms. That’s something no one has been able to do so far.

Re: Dall-E 2

#358

Post by [deleted] »

aliakhtar wrote: post #349
kromem wrote: post #338

Earlier quoted context omitted.

I don't think it's necessarily certain villainy for those who fight that fight as long as they are fighting it correctly. There's a huge case to be made that flooding the darknet with AI generated CP reduces the revictimization of those in authentic CP images, and would cut down on the motivating factors to produce authentic CP (for which original production is often a requirement to join CP distribution rings). As w…

How do you suppose your CP generator will be trained without using authentic CP images? Not only will that require revictimization but you’ll also be downloading CP to train the model.

[deleted]

Re: Dall-E 2

#359

Post by astrange »

mahastore wrote: post #267
recuter wrote: post #73

Earlier quoted context omitted.

What always bother me with this stuff is, well, you say one approach is more sensible than the other because the images happen to come out more pleasing. But there's no real rhyme or reason, it is a sort of alchemy. Is text encoding strictly worse or is it an artifact of the implementation? And if it is strictly worse, which is probably the case, why specifically? What is actually going on here? I can't argue that th…

I wish there was something available in open source that has similar functions i.e sensible amalgamation of pictures based on some text.

https://github.com/borisdayma/dalle-mini

https://rudalle.ru/en/

Smaller reproductions of the original research.

Re: Dall-E 2

#360

Post by sneak »

uoaei wrote: post #353
falcor84 wrote: post #246

>We’ve limited the ability for DALL·E 2 to generate ... adult images. I think that using something like this for porn could potentially offer the biggest benefit to society. So much has been said about how this industry exploits young and vulnerable models. Cheap autogenerated images (and in the future videos) would pretty much remove the demand for human models and eliminate the related suffering, no? EDIT: typo

No. If people are exposed to stimuli, they will pursue increasingly stimulating versions of it. I.e., if they see artificial CP, they will often begin to become desensitized (habituated) and pursue real CP or even live children thereafter. Conversely, if people are not exposed to certain stimuli, they will never be able to conceptualize them, and thus will be unable to think about them. Obviously you cannot eliminate…

> If people are exposed to stimuli, they will pursue increasingly stimulating versions of it. I.e., if they see artificial CP, they will often begin to become desensitized (habituated) and pursue real CP or even live children thereafter.

I have accumulated tens of thousands of headshots in video games but have yet to ever shoot a single real person in the face. More importantly, I have never had the urge to seek out same.

I am not sure that your initial premise has any truth to it.

Post reply on HN