Is DALL-E publicly available or what? How do I work on generating images?
DALLE-2 (from OpenAI) isn't, but DALLE Mini (from huggingface) is: https://huggingface.co/spaces/dalle-mini/dalle-mini
How Good Is DALL-E Mini at Origami?
21–30 of 31 posts
Re: How Good Is DALL-E Mini at Origami?
#22I don't mean this to sound overly negative, because I absolutely think DALL-E is a killer app amongst recent AI advances. But the thing that made DALL-E astonishing is that it was... good. While DALL-E Mini mimics a lot of the technical advances and you can kind of see what it's getting at with its outputs, they're still mostly garbage. Very clever garbage! But they lack the emotional impact that - woah! - this is do…
What makes DALLE Mini great is that we can all sit down and play with it, with no "oh this thing might destroy humanity" warning. A warning that most people who have worked seriously on different areas of AI find annoying for different reasons, but mainly it feels like a marketing gimmick to draw attention. I have lots of friends who aren't related to the tech field having lots of fun playing with DALLE Mini, even th…
> What makes DALLE Mini great is that we can all sit down and play with it, with no "oh this thing might destroy humanity" warning
It seems like the DALL-E creators are mostly worried about the (possibly justified!) fear that people will use it to make racist or other offensive imagery, and it would bring very bad PR to the team.
Re: How Good Is DALL-E Mini at Origami?
#23Earlier quoted context omitted.
Don't overestimate humans. Most people (adults, not toddlers) can't even draw a bicycle, even if they used one for most of their lives, so presumably they have a conceptual understanding of how it looks and works. https://www.fastcompany.com/3059089/it-turns-out-its-almost-...
This example gets trotted out a lot but I don't really understand it. Why do we assume cyclists have a conceptual mechanical understanding of a bicycle and can remember its exact appearance? If they build or repair bicycles, sure, but the majority of people don't do that. They just have learnt how to operate one by instinct.
I think that's the point, the bike example shows people have some concept of what a bike is (pedals, wheels, frame) even without an exact understanding of it, or a precise image in mind.
It's the same for "draw a house". You may do a square facade, triangular roof, windows, chimney, door. It is equally unrealistic, because people don't have a clue how tall floors should be, have no sense of proportion etc..
It's just that in the bike case it's more obviously wrong.
Re: How Good Is DALL-E Mini at Origami?
#24Checked the model, and the "model card" https://huggingface.co/dalle-mini/dalle-mini#bias is an interesting exercise in sensitivity absurdity:
"Bias
CONTENT WARNING: Readers should be aware this section contains content that is disturbing, offensive, and can propagate historical and current stereotypes."
Spoiler alert, nothing contained in that section requires a warning. It's just abstract descriptions of "potential" negative stereotypes in images.
"initial testing demonstrates that they may generate images that contain negative stereotypes against minoritized groups"
Minoritized is a new word for me. As though minority status is something actively attached to someone. But no duh I can ask dalle to generate "images of klan members at a lynching" or "inner city police brutality" and get negative images.
"When the model generates images with people in them, it tends to output people who we perceive to be white, while people of color are underrepresented."
I'd like to see real testing, because from what I can tell this is not true. Ask for "white people" and you get weird abstract models of white figures. Ask for "black people" and you get beautiful photos of smiling black faces.
Is this the kind of exercise AI researchers have to concern themselves with these days?
Re: How Good Is DALL-E Mini at Origami?
#25One related property of GPT-3: It's very bad at traditional computational tasks. * "Make a list of 20 items" results in a list. The number of items is as accurate as if you asked a toddler the same question. * If you ask GPT-3 a simple combinatorics question, it will be 100% confident in the wrong answer. Origami is sort of the same. It takes a conceptual understanding of how paper folds, which DALL-E Mini doesn't ha…
Don't overestimate humans. Most people (adults, not toddlers) can't even draw a bicycle, even if they used one for most of their lives, so presumably they have a conceptual understanding of how it looks and works. https://www.fastcompany.com/3059089/it-turns-out-its-almost-...
Actual webpage for the artist's project: https://www.gianlucagimini.it/portfolio-item/velocipedia/
Re: How Good Is DALL-E Mini at Origami?
#26Just tried all of the prompts from the OP's post on OpenAI's DALL-E 2 - https://harishgarg.com/writing/generating-origami-images-usi...
DALL-E 2 beats Mini in almost all of them.
Re: How Good Is DALL-E Mini at Origami?
#27Checked the model, and the "model card" https://huggingface.co/dalle-mini/dalle-mini#bias is an interesting exercise in sensitivity absurdity: "Bias CONTENT WARNING: Readers should be aware this section contains content that is disturbing, offensive, and can propagate historical and current stereotypes." Spoiler alert, nothing contained in that section requires a warning. It's just abstract descriptions of "potential…
The statement was copied wholesale from OpenAI, and the DALL•E mini implementation simply isn't as capable at depicting people, so the biases aren't as apparent. Yet.
Re: How Good Is DALL-E Mini at Origami?
#28Re: How Good Is DALL-E Mini at Origami?
#29One related property of GPT-3: It's very bad at traditional computational tasks. * "Make a list of 20 items" results in a list. The number of items is as accurate as if you asked a toddler the same question. * If you ask GPT-3 a simple combinatorics question, it will be 100% confident in the wrong answer. Origami is sort of the same. It takes a conceptual understanding of how paper folds, which DALL-E Mini doesn't ha…
Don't overestimate humans. Most people (adults, not toddlers) can't even draw a bicycle, even if they used one for most of their lives, so presumably they have a conceptual understanding of how it looks and works. https://www.fastcompany.com/3059089/it-turns-out-its-almost-...
I feel like we underestimate how close these systems are to sentience, largely by virtue of overestimating humans.
The largest ML systems of today have roughly the same complexity as human brains, and evolve in much the same way. The brain has 100 billion neurons, and GPT-3 has 175 billion parameters. Neurons and parameters aren't comparable, but there isn't an obvious advantage in either direction. Neurons have more parameters than ML parameters, but also operate at around 10Hz, versus many, many MHz.
That doesn't mean machine sentience will be anything like human sentience. Brain disorders are helpful to look at here -- there are people who don't experience specific emotions (e.g. pain, fear, etc.). Even a minor tweak can have a major impact. That's far less than, for example, evolving without evolutionary pressure for self-preservation, for pro-social behavior, or with the sort of ephemeral nature of ML systems.
Re: How Good Is DALL-E Mini at Origami?
#30Earlier quoted context omitted.
DALLE-2 (from OpenAI) isn't, but DALLE Mini (from huggingface) is: https://huggingface.co/spaces/dalle-mini/dalle-mini
When can we get our hands on DALLE-2?
You can sign up for beta access in the meantime, but OpenAI hasn't given a timeline for access. I think eventually they'll open up some kind of playground like they did with GPT-3 and sell the service to other businesses.
Currently some prominent AI researchers, artists, and journalists have access to DALLE-2, and some have been taking requests from social media and posting the results, like https://twitter.com/hardmaru/, so you can check their feed for a few examples or give a few ideas when they ask again for ideas.