TL;DR: AI doesn't understand human language prompts, it's just associating specific tokens with specific outputs.
The Lone Banana Problem in AI
91–100 of 109 posts
Re: The Lone Banana Problem in AI
#92At Digital Science, we believe that we have a responsibility to ensure that the technologies that we release are well tested and well understood. The use cases where we deploy AI have to be appropriate for the level at which we know the AI can perform and any functionality needs to come with a “health warning” so that people know what they need to look for – when they can trust an AI and when they shouldn’t.
We don't even understand ourselves and we hope to model AI alignment in some image of humanity with the goal that it will be just as benevolent as our fractured war eager society.
Yes it is a paradox indeed. I submit there is likely a limitation to how much theoretically AI could ever improve beyond ourselves in the regards to bias. I've described this as the AI Bias Paradox - https://www.mindprison.cc/p/ai-the-bias-paradox
Re: The Lone Banana Problem in AI
#93I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.
This is the biggest communication problem most people have. Say it plain and simple. No one wants to read your train of thought.
Nah. It's either the 2nd biggest communication problem, or a side effect of a bigger problem. Depending on how you analyse it.
The biggest communication problem is that you always need to take into account that your reader might be braindead trash. That has two consequences:
1. Unless you expose your full train of thought, expect screeches like "I dun unrurrstand, SPOONFEED ME BASIC REASONING, REEE".
2. Unless you explicitly say something, expect some assumer to claim that you said the opposite. Bonus points if this is due to failure to take context into account, or even notice that the context is missing.
Both consequences have been training writers to idiot-proof their texts with big walls of unnecessary words. And that's the case here.
Re: The Lone Banana Problem in AI
#94Earlier quoted context omitted.
https://r.nf/r/midjourney/top/?sort=top&t=year Don't feed the beast.
how is that still working after the api-ocalypse?
Source is here for inspection.
https://github.com/libreddit/libreddit
You can self-host it as well.
Re: The Lone Banana Problem in AI
#95[deleted]
Re: The Lone Banana Problem in AI
#96I wish this article was just 3 paragraphs. The verbose writing style was a little tiring, I found myself scrolling impatiently to find what the actual "Lone Banana Problem" was.
you're stumbled upon the Lone Writer problem.
Re: The Lone Banana Problem in AI
#97This isn't a real problem anymore. Composable Diffusion, Regional Prompting, and Controlnet literally solved all of these issues. The author shows what the world is learning, "Johnny can't prompt", and those who learn how to use Generative AI well are going to be continuing to propel up in their careers while the general public incorrectly concludes that the tools "don't work".
Re: The Lone Banana Problem in AI
#98Filling in the blank with what has not happened. LLMs interpolate quite well but they don't extrapolate. Very interesting article where you can or cannot put LLMs to use. It's not necessarily a bug, but we are yet to see.
They extrapolate just fine. It's the image nets that don't. Here's my excerpt with GPT-4: As an AI, I can't actually see the painting, but based on the title and the dimensions you've provided, I can imagine a possible description. The painting, titled "Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style," is a large piece, standing 6 feet tall and 4 feet wi…
Most of what you think is extrapolation is interpolation.
Models do NOT extrapolate unless they are given access to resources/data that is not somehow in their training dataset.
We have done so much encoding of knowledge that a majority of serious use-cases for LLMs are Interpolation, but the fact that we even need retrieval augmented generation shows that they do not extrapolate.
Re: The Lone Banana Problem in AI
#99LLMs don't understand meaning, they're just a statistical random number generator.
You're just a statistical number generator...
Re: The Lone Banana Problem in AI
#100Earlier quoted context omitted.
I wouldn't use "bias" here. It's a very ambiguous term in machine learning.
Not sure what a better term would be... Just being more specific might help, like "bias in the training data"?
But what does that mean? That the training distribution isn't representative of the population distribution, i.e. that it wasn't sampled IID? But the professors look pretty representative of real professors to me, so this doesn't sound very likely.