Earlier quoted context omitted.
> If the litmus test for intelligence Moving goal posts around is unhelpful. I think my comment was pretty clear in the context of AGI and calling ChatGPT a "math genius."
The fact that people take agi to mean "can invent new math" is a goalpost shift on its own. That was not the original meaning (generally intelligent), that wasn't even the next moved goal (on par with human experts). I guess the next one counts (better than all human experts) but i'm sure we'll move that again too.
I don't think this is a goalpost shift at all. I agree that GPT actually is "generally intelligent" but then so is Google Search. The point of the term AGI is that it has generally applicable intelligence that is on par with a human, I don't think that's really changed.
The problem with GPT is still that every single interaction I've had with it, I've pointed out issues with its logic and it is incapable of understanding my objection. It agrees with whatever I say and then immediately repeats the same mistake. And these aren't "invent new math" questions, there's a very clear inability to follow a logical chain of cause and effect.
I should be clear at the same time I still have a feeling ChatGPT might be conscious. It's obviously kind of a dreamlike consciousness without ability to hold state but it does feel like it could be conscious.