Live data from Hacker News

The Lone Banana Problem in AI

digital-science.com

101–109 of 109 posts

Re: The Lone Banana Problem in AI

#101

I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.

Do you really not know how to skim effectively? Took me just a few seconds.

Right? I'm running a fever right now and I had no trouble with this article.

Re: The Lone Banana Problem in AI

#102
post #90
post #84

Earlier quoted context omitted.

Right, so your 90 seconds is actually closer to 10 minutes for most people. That's a lot of time to communicate "AI tends to render one banana as two bananas", which was OP's point. Yes, there were pictures that communicated the same thing, but people naively thought that those 2348 words may actually hold some additional information, as otherwise ca 2300 of them would be completely superfluous. But they were wrong;…

I don't think that the time difference is that big. I'm fast, but I don't think I'm that much faster than an average skim reader. As I said, the title of the article and a couple of image captions are enough to get the gist, and as such, I find it baffling that so many people seem to have totally failed to understand it.

[deleted]

Re: The Lone Banana Problem in AI

#103
It's really weird that the monkey is eating two bananas at once, I would think in training data monkeys would almost always be eating one banana at a time.

I've been told that in the real world monkeys and chimps don't peel bananas when they eat them, they eat the peel and all, but i don't know if it's true. Whatever happens in the real world, drawings always show monkeys peeling the bananas as they eat them and I would expect a prompt "show a monkey eating a banana" to show it eating a single peeled banana.

Re: The Lone Banana Problem in AI

#104
post #30

> Then think of all the wealth disparity that has been introduced into our world. Think of the social anxiety of always being online. Think of the undermining of our democratic institutions. How is this at all whatsoever needed

It isn't really. But those are the hivemind memes and not agreeing with their bullcrap gets you looked at like you are a crazy person or worse, not part of the in crowd. High school has done some serious and lasting damage to socialization throughout the world as social backbiting popularity bullshit became the norm.

Not to mention complaining about wealth disparity from investment as if it is a sin of the technology is asinine. If money can produce better results you will see wealth disparity from the simple feedback loop of "more money -> better results -> more money". Your neighbor taking up jogging while you sit on the couch all day is increasing a health disparity, should your neighbor stop jogging then?

Undermining of democratic institutions is just plain a dumb meme from vested interests who cast what were previously abuses or necessary evils of the system at best as integral to democracy. We would all recognize blaming the media for undermining the Catholic Church by documenting their child sexual abuse as batshit insane. Yet somehow it is different when it comes to newspapers moaning about their loss of monopolies and influence of cliques.

Re: The Lone Banana Problem in AI

#105

I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.

> I wish this article was just 3 paragraphs. AI might have problems with single bananas, but it can do that very well: > In an experiment with the AI program Midjourney, the author found a peculiar issue: the program rendered images of monkeys holding bananas, but it consistently depicted two or more bananas even when asked to render a single banana. The author suggests that the AI’s predilection for rendering multip…

That's immediately inaccurate in a way that distorts the whole article.

The author was trying to produce a single banana on a grey background.

The monkey was a later attempt at prompt engineering.

That AI summary is completely misleading.

Re: The Lone Banana Problem in AI

#106
post #71

Earlier quoted context omitted.

Yeah, I am a speedreader, and I did used to be able to do circa 3000wpm at a push. Good to know that even as a myopic 55YO I can still do half that without trying. Points of comparison: I originally read Hal Clement's classic Mission of Gravity in about 25min, and Joseph Conrad's Victory in about 3 hours.

Did you forget you’re a speed reader when asserting how long it should take to read the whole article?

No. I expect people to be able to skim.

If the can't skim, for example if they are a foreign language speaker of low-intermediate ability (as I am in 5 or 6 languages, and I am also a professional language teacher among other things), then I expect them to know that they can't skim, and make appropriate allowances.

Re: The Lone Banana Problem in AI

#107

Earlier quoted context omitted.

> I wish this article was just 3 paragraphs. AI might have problems with single bananas, but it can do that very well: > In an experiment with the AI program Midjourney, the author found a peculiar issue: the program rendered images of monkeys holding bananas, but it consistently depicted two or more bananas even when asked to render a single banana. The author suggests that the AI’s predilection for rendering multip…

That's immediately inaccurate in a way that distorts the whole article. The author was trying to produce a single banana on a grey background. The monkey was a later attempt at prompt engineering. That AI summary is completely misleading.

The lone summary problem

Re: The Lone Banana Problem in AI

#108

I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.

> I wish this article was just 3 paragraphs. AI might have problems with single bananas, but it can do that very well: > In an experiment with the AI program Midjourney, the author found a peculiar issue: the program rendered images of monkeys holding bananas, but it consistently depicted two or more bananas even when asked to render a single banana. The author suggests that the AI’s predilection for rendering multip…

The problem with generated summaries as opposed to generated code for example, is that there is no way to verify them without reproducing the entire thing "manually".

Can't do better then brute force for verification.

Re: The Lone Banana Problem in AI

#109
post #78

Earlier quoted context omitted.

And is RL not? All of these models are constrained by finite weights and then tuned. Are you suggesting we grow a neural network until certain criterion are met with regard to out of distribution test criteria? Hmm

What would that buy you? You train until you push your loss under a certain threshold, then check the external criteria and if they don't hold you train again? Your external criteria would essentially become another part of your loss function, but the whole training would become vastly more inefficient. I'm saying that we shouldn't expect the models to come up with things we didn't train them to come up with.

Yeah, it wouldn't buy us anything additional. The only way to really verify would be to look at out of distribution inputs and see if they satisfy what we'd really like. Wouldn't that be true generalization? Otherwise our model architectures or training data is insufficient.
Post reply on HN