I'm seeing a lot more people experimenting with DALL-E 2. How does getting access work, do you need a referral?
There is a waitlist, but OpenAI just announced they are opening access more widely from it.
I wonder why they call it "Open"AI
DALL-E 2 has a secret language
71–80 of 118 posts
Re: DALL-E 2 has a secret language
#72Was DALL-E 2 trained on captions from multiple languages? If so, this makes a lot of sense. Somewhere early in the model the words "bird", "vogel", "oiseau" and "pájaro" have to be mapped to the same concept. And "Apoploe vesrreaitais" happens to map to the same concept. Or maybe "Apoploe vesrreaitais" is rather the tokenization of that concept, since it also appears in the output. So in a sense DALL-E is using an in…
This looks like the artificial language Lojban was constructed: its words share parts from completely unrelated languages to the point when none of the original words are recognizable in the result.
The original words aren't recognizable at first glance, but they do serve as potential mnemonics for remembering the terms/definitions for any learners who speak one of those source languages (English, Spanish, Mandarin, Arabic, Russian, Hindi)
Re: DALL-E 2 has a secret language
#73If I understand correctly from the twitter thread (I haven't read the linked
technical report) the author and a collaborator found that DALL-E generated some
gibberish in an image that showed two men talking, one holding two ... cabbages?
They fed (some of) the gibberish back to DALL-E and it generated images of
birds, pecking at things.
Conclusion: the gibberish is the expression for birds eating things in DALL-E's secret language.
But, wait. Why is the same gibberish in the first image, that has the two men and the cabbages(?), but no birds?
Explanation: the two men are clearly talking about birds:
>> We then feed the words: "Apoploe vesrreaitars" and we get birds. It seems that the farmers are talking about birds, messing with their vegetables!
With apologies to my two compatriots, but that is circular thinking to make my head spin. I'm reminded of nothing else as much as the scene in the Knights of the Round Table where the wise Sir Bedivere explains why witches are made of wood:
Re: DALL-E 2 has a secret language
#74Earlier quoted context omitted.
You are wrong. Had it been that simple I would __not__ have suggested that and for whatever reason I find your reply borderline infuriating but I can't pinpoint exactly why that is. Regardless, here is me, a native speaker, disproving your hypothesis. I tried the following words in google translate elefantas ailaifantas ailaiphantas elaiphandas elaiphandac. The suggested detections are ελέφαντας, αιλαιφάντας, αιλαιφά…
> for whatever reason I find your reply borderline infuriating but I can't pinpoint exactly why that is. I guess that says more about you than about my reply. Also, I'm a native speaker as well. That doesn't really have any bearing, my comment above comes from what I know about common implementations of language detection algorithms, not so much from looking at how Google Translate behaves.
And I was honest about how I felt given how you structured it.
It does have a lot of bearing actually. While I am a native speaker, my spelling skills are atrocious as everything is a sequence of sounds in my head more so than a sequence of letters. To get around my spelling issues I frequently use homophones to find the correct spelling of a word which uses soundex or similar algorithms to find the correct word along with character mappings between the two languages.
Regardless, I believe I have proved the hypothesis to not be true.
Re: DALL-E 2 has a secret language
#75Gavagai!
(explaining the joke: https://en.m.wikipedia.org/wiki/Indeterminacy_of_translation )
Re: DALL-E 2 has a secret language
#76[deleted]
Re: DALL-E 2 has a secret language
#77Re: DALL-E 2 has a secret language
#78Shouldn't this be expected to a certain extent? Gibberish has to map _somewhere_ in the models concept space. Whether is maps onto anything we'd recognise as consistent doesn't mean that the AI wouldn't have some concept of where it relates, as other people have noted, the gibberish breaks down when you move it into another context, but who's to say that Dall-E 2 isn't remaining consistent to some concept it understa…
> Shouldn't this be expected to a certain extent?
In hindsight, sure. Given enough time someone might have predicted the phenomenon. But I don't think most of us did.
What's more fascinating to me is how often this has happened in this space in just the last few years.
1. Some phenomenon is discovered
2. I'm surprised
3. It makes sense in hindsight
Re: DALL-E 2 has a secret language
#79[deleted]
Re: DALL-E 2 has a secret language
#80I love this scientific curiosity towards DALL-E. Many people just say that it's bad at text generation (including me), but someone stopped to wonder if this is really gibberish or it has some logic to it. Classic "hmm, that's odd" case.
It will be fun to see people experimenting with extracting text prompts from generated images. I'd try something like "An open children book about animals" or "Random thought written on a paper". Maybe do a feedback loop of extracted prompts :)