Live data from Hacker News

The Lone Banana Problem in AI

digital-science.com

31–40 of 109 posts

Re: The Lone Banana Problem in AI

#31

Midjourney solution: "--no bunch, two, multiple": https://i.imgur.com/QnJmLr0.jpeg These models have a tendency to move towards the average, especially if unprompted. As we see here, sometimes even if prompted otherwise. They just have to get better or need a more precise interface like the —no :). We also couldn't have "a man crawling" before and now we can: https://i.imgur.com/ycVpk3i.jpeg

--no is too strong, it ruins the quality because of negative weight pollution. Something like :: bunch, two, multiple::-0.3 would probably be enough without making them look worse

Re: The Lone Banana Problem in AI

#32

I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.

It was probably 3 paragraphs before they ran it through a prose-generating LLM. Now we need to use an LLM to condense it back down.

Re: The Lone Banana Problem in AI

#33

I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.

This is the biggest communication problem most people have.

Say it plain and simple. No one wants to read your train of thought.

Re: The Lone Banana Problem in AI

#35

"Three cats in a trenchcoat" is a good one. Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style. You can get them standing side by side wearing trenchcoats. You can get a cat pyramid or a cat totem or a stack or tower of cats (though often the ability to count to three is then lost). You can't get them to share the trenchcoat. Nothing like that occurred in a…

It's mostly the generation engine, not the logical AI. Here's what GPT-4 says when asked to describe.

> As an AI, I can't actually see the painting, but based on the title and the dimensions you've provided, I can imagine a possible description.

> The painting, titled "Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style," is a large piece, standing 6 feet tall and 4 feet wide.

> At the bottom of the painting, the trenchcoat's hem brushes the ground, obscuring the cats' feet. The trenchcoat is a deep, rich color, perhaps a classic trenchcoat beige or a more dramatic black or navy. The coat is painted with careful detail, showing the texture of the fabric and the gleam of buttons.

> Moving up the painting, the middle section reveals the outline of three cats stacked on top of each other within the coat. The artist might have chosen to show this through a slightly open coat, or perhaps through the distinctive shapes visible under the fabric. The cats could be of different breeds and colors to add visual interest and humor.

> The top third of the painting, the upper two feet, features the head of the topmost cat peeking out from the collar of the trenchcoat. The cat might be looking straight ahead, trying to maintain its human disguise, or it might be looking out at the viewer with a humorous or mischievous expression. If the artist chose to include a hat, it would be perched on the cat's head, adding to the disguise.

> The background of the painting could vary greatly depending on the artist's style and intentions. It could be a simple, solid color to keep the focus on the cats, or it could be a detailed scene that adds to the story - perhaps a city street to tie in with the Vincent Adultman reference, or a domestic setting to contrast with the cats' unusual behavior.

> Again, this is a hypothetical description and the actual painting could be very different.

Re: The Lone Banana Problem in AI

#36
post #20

Earlier quoted context omitted.

On /r/midjourney subreddit there are posts like "the most stereotypical person in [state/country]", "what midjourney thinks professors look like based on their department". You can see some interesting biases in the training data. https://www.reddit.com/r/midjourney/top/?sort=top&t=year

https://r.nf/r/midjourney/top/?sort=top&t=year Don't feed the beast.

Although "not feeding the beast" doesn't inspire me much, it is notable that https://r.nf/ can display images without using javascript!

Re: The Lone Banana Problem in AI

#37
post #23

Again, there is a lot of words to describe the fact that machine learning is just lossy compression for a bunch of data with the possibility to interpolate between data points and get somewhat plausible results. This means data points may get lost during compression/training, and certain things will look off, whether it be a preference for banana pairs, even numbers of fingers or certain weasel words in verbiage.

And is RL not? All of these models are constrained by finite weights and then tuned. Are you suggesting we grow a neural network until certain criterion are met with regard to out of distribution test criteria? Hmm

Re: The Lone Banana Problem in AI

#38
post #18

> A single banana casting a shadow on a grey background That prompt works fine in DALL·E 2.

I can understand the logic behind why "a single banana" doesn't prevent two bananas from showing up though: there is a single banana casting a shadow on a grey background in the image. And then there is another one. That's why you have to specify "on its own" to get rid of the second one...

If you look at the examples in the post, the two bananas are usually joined, so definitely not single. So I think your explanation is overthinking it.

Re: The Lone Banana Problem in AI

#39

Filling in the blank with what has not happened. LLMs interpolate quite well but they don't extrapolate. Very interesting article where you can or cannot put LLMs to use. It's not necessarily a bug, but we are yet to see.

They extrapolate just fine. It's the image nets that don't.

Here's my excerpt with GPT-4:

As an AI, I can't actually see the painting, but based on the title and the dimensions you've provided, I can imagine a possible description.

The painting, titled "Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style," is a large piece, standing 6 feet tall and 4 feet wide.

At the bottom of the painting, the trenchcoat's hem brushes the ground, obscuring the cats' feet. The trenchcoat is a deep, rich color, perhaps a classic trenchcoat beige or a more dramatic black or navy. The coat is painted with careful detail, showing the texture of the fabric and the gleam of buttons.

Moving up the painting, the middle section reveals the outline of three cats stacked on top of each other within the coat. The artist might have chosen to show this through a slightly open coat, or perhaps through the distinctive shapes visible under the fabric. The cats could be of different breeds and colors to add visual interest and humor.

The top third of the painting, the upper two feet, features the head of the topmost cat peeking out from the collar of the trenchcoat. The cat might be looking straight ahead, trying to maintain its human disguise, or it might be looking out at the viewer with a humorous or mischievous expression. If the artist chose to include a hat, it would be perched on the cat's head, adding to the disguise.

The background of the painting could vary greatly depending on the artist's style and intentions. It could be a simple, solid color to keep the focus on the cats, or it could be a detailed scene that adds to the story - perhaps a city street to tie in with the Vincent Adultman reference, or a domestic setting to contrast with the cats' unusual behavior.

Again, this is a hypothetical description and the actual painting could be very different.

Post reply on HN