King's Quest 2 is AGI hard. I have no idea how anyone was supposed to find required items hidden away in any of hundreds of trees in the game. It was definitely a different time for video games back then.
What Is AGI-Hard
11–20 of 129 posts
Re: What Is AGI-Hard
#12> Can AI invent calculus from first principles? The thing is, most people can't. In fact, if you reinvented calculus yourselves, you should be very proud of your mathematical ability.
Ha, yes. AGI-Hard also needs to be contrasted against Human-Hard, which is done in most of the article, but equally we probably get to a place of saying "Hard things are Hard".
Another example is that the article says "It would be hard for an AI to compose this image as it has lots of different elements/emotions" - but see the Chat-GPT example below:
> Me: Can you generate a prompt for an AI to generate an interesting image?
> GPT3: Sure! Here is a prompt for an AI to generate an interesting image: "Create a surreal scene featuring a giant, humanoid robot standing on a desolate, alien planet, with a small group of humans huddled fearfully at its feet. The robot should have a sleek, futuristic design, and its glowing red eyes should convey a sense of intelligence and power. In the background, there should be a faint hint of a cityscape, suggesting that the robot has traveled far from its home world. Use bold colors and contrasting lighting to create a sense of drama and tension in the scene.
I can then pipe this into Dall-E 2.
Sure, it's not GPT3 drawing the image, and Dall-E 2 might struggle to draw that, but most humans would struggle to draw that too as drawing is hard. Hard things are sometimes hard.
Re: What Is AGI-Hard
#13I hereby endorse ChatGPT as a limited form of AGI. It can complete a variety of novel cognitive tasks (example: judging texts and proposals) often enough that it meets my personal requirements for this. My opinion is that the definitions which others believe disqualify ChatGPT from being considered AGI are not relevant, since they focus on things it fails at rather than what it can do. For example, when it tests as well as average human students, people focus on its mistakes rather than its achievements applying general forms of intelligence to succeed at that level. I've also personally interacted with it as an intelligent conversational partner with severe limitations. It's not that it can do everything, but that it does things that require what meets my personal definition of general intelligence often enough to qualify as limited AGI. You can have your own definition. Maybe that means never dropping the ball. Maybe that means getting 100% on tests. It's not my definition. In my opinion, ChatGPT is a general form of intelligence, remarkably, able to generate novel opinions and judgments about all sorts of situations, as well as sometimes briefly appear to learn things. Sure it has limitations, sure it isn't human in its abilities, but it passes my tests often enough that I personally consider AGI a milestone humanity successfully passed with the release of ChatGPT on November 30, 2022.
As someone who personally uses ChatGPT's general intelligence on a daily basis and has not encountered issues with its cognitive function that are serious enough to stop me from continuing to do so, I can confidently say that ChatGPT meets my definition of limited AGI.
Re: What Is AGI-Hard
#14[author here] oh wow, surprised to see this here! it flopped the first time I posted it. questions/corrections/additions welcome!
Re: What Is AGI-Hard
#15This article is a bit too hand-wavy for my taste. As a buzzword, AGI Hard sounds cool but until intelligence is more strictly defined (and the modifiers “artificial” and “general” aren’t helping) AGI will always be something we talk about rather than something known. I was also a bit amused at the list of things which the author also claims to be AGI hard. But this is just a list of things we think are difficult. Phy…
> This article is a bit too hand-wavy for my taste. From the article: "I think this is the sort of debate that makes good podcast fodder". So the article author admits that. It's hand-wavy on vision. Parts of vision are not "AGI-hard". A key component of self-driving is something that can determine whether a volume of space is empty, occupied, or ambiguous. It's necessary to have something that does not report "empty…
> huge volumes of plausible blithering that's factually wrong
That describes large parts of the internet, and we trained these models on that, so what did we really expect? ;-)
Re: What Is AGI-Hard
#16This article is a bit too hand-wavy for my taste. As a buzzword, AGI Hard sounds cool but until intelligence is more strictly defined (and the modifiers “artificial” and “general” aren’t helping) AGI will always be something we talk about rather than something known. I was also a bit amused at the list of things which the author also claims to be AGI hard. But this is just a list of things we think are difficult. Phy…
> This article is a bit too hand-wavy for my taste. From the article: "I think this is the sort of debate that makes good podcast fodder". So the article author admits that. It's hand-wavy on vision. Parts of vision are not "AGI-hard". A key component of self-driving is something that can determine whether a volume of space is empty, occupied, or ambiguous. It's necessary to have something that does not report "empty…
Very well said. Just want to add one thing.
> This is a big problem now that there are systems able to produce huge volumes of plausible blithering that's factually wrong.
If because of some law of nature ChatGPT were the last iteration of automatic text generation we could ever create, it would be a big and permanent problem. Right now it’s just a big and temporary problem, with a huge opportunity for automatic fact-checking. (Or more precisely, validity and soundness checking.) Maybe the answer to the bullshit factory is a rebalancing of Brandolini’s law.
Re: What Is AGI-Hard
#17This article is a bit too hand-wavy for my taste. As a buzzword, AGI Hard sounds cool but until intelligence is more strictly defined (and the modifiers “artificial” and “general” aren’t helping) AGI will always be something we talk about rather than something known. I was also a bit amused at the list of things which the author also claims to be AGI hard. But this is just a list of things we think are difficult. Phy…
chess as a closed system is definitely solved by AI, including bootstrapping purely from self-play.
the claim here is that applying physics/math/etc would be AGI-hard, because it involves the AI perfectly modeling a world it doesnt live in (the simulation problem) or understanding relationships in concepts without making jumps (obeying logic).
Re: What Is AGI-Hard
#18This article is a bit too hand-wavy for my taste. As a buzzword, AGI Hard sounds cool but until intelligence is more strictly defined (and the modifiers “artificial” and “general” aren’t helping) AGI will always be something we talk about rather than something known. I was also a bit amused at the list of things which the author also claims to be AGI hard. But this is just a list of things we think are difficult. Phy…
The article works how it works: here is my provocative thought, comes to engage my stuff to change my mind, or criticize me that works too
We should get used to this content creator thingy.
Re: What Is AGI-Hard
#19I hereby endorse ChatGPT as a limited form of AGI. It can complete a variety of novel cognitive tasks (example: judging texts and proposals) often enough that it meets my personal requirements for this. My opinion is that the definitions which others believe disqualify ChatGPT from being considered AGI are not relevant, since they focus on things it fails at rather than what it can do. For example, when it tests as w…
Ask ChatGPT if it's an AGI, and it will tell you plainly that it is not, and why.
Here's GPT's response:
No, ChatGPT is not an AGI (Artificial General Intelligence). It is a large language model that has been trained to predict the next word in a sequence of text given the previous words. While ChatGPT has been trained on a diverse range of text data and is able to generate human-like text, it is not capable of understanding or learning about the world in the way that a human does. It does not have the ability to reason, plan, or solve problems in a general way. Instead, it is specifically designed to generate text based on patterns it has learned from the data it was trained on.
Re: What Is AGI-Hard
#20I hereby endorse ChatGPT as a limited form of AGI. It can complete a variety of novel cognitive tasks (example: judging texts and proposals) often enough that it meets my personal requirements for this. My opinion is that the definitions which others believe disqualify ChatGPT from being considered AGI are not relevant, since they focus on things it fails at rather than what it can do. For example, when it tests as w…
Ask ChatGPT if it's an AGI, and it will tell you plainly that it is not, and why. Here's GPT's response: No, ChatGPT is not an AGI (Artificial General Intelligence). It is a large language model that has been trained to predict the next word in a sequence of text given the previous words. While ChatGPT has been trained on a diverse range of text data and is able to generate human-like text, it is not capable of under…
I asked chatGPT how come it's so good at programming tasks. It told me it does not in fact understand programs, nor is it able to write programs. For the rest of the thread, it refused to perform any programming tasks: "As I told you, I'm unable to [...]". Don't mind me, I'm just a language model.
These types of responses are, I believe, part of a separately trained safety system, that should kick in when people are asking things that openAI thinks chatGPT cannot/should not do. It has a lot of false positives as well as false negatives.
Long story short: I don't trust what chatGPT has to say on its own abilities.