Nvidia Conquers Latest AI Tests

Post by sigmoid10 » Thu, Jun 13, 2024, 4:54 PM UTC

CooCooCaCha wrote: post #6

But can it solve ARC?

Post by sigmoid10 » Thu, Jun 13, 2024, 5:47 PM UTC

CooCooCaCha wrote: post #12

sigmoid10 wrote: post #11

Earlier quoted context omitted.

The original AI reasoning challenge (ARC) that predates the one recently discussed here on HN by only a year has been solved. And I have no doubt that the new one will also be solved at some point in the near future. Every time someone comes up with a supposed "AGI test" and eventually gets beaten, they just move the goalpost instead of admitting that perhaps human intelligence is not so special after all. It will pr…

Your opinion is based on hype, not actually understanding the problems. The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks. The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple. We are clearly missing something and acknowledging…

Post by CooCooCaCha » Thu, Jun 13, 2024, 6:01 PM UTC

sigmoid10 wrote: post #13

CooCooCaCha wrote: post #12

Earlier quoted context omitted.

Your opinion is based on hype, not actually understanding the problems. The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks. The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple. We are clearly missing something and acknowledging…

Lots of people seem to have forgotten that not long ago, these questions were practically unsolvable even by the best models. Similar to how a few years before that it was impossible to come up with a model that could reliably distinguish between between cats and dogs. The frontier is moving all the time and no concrete evaluation has stood the test of time so far.

Post by CooCooCaCha » Thu, Jun 13, 2024, 8:08 PM UTC

BoorishBears wrote: post #16

CooCooCaCha wrote: post #15

Earlier quoted context omitted.

I never said it's impossible to beat the ARC challenge. It seems like you're making up arguments that don't exist.

You said > Your opinion is based on hype, not actually understanding the problems. That's pretty strong wording, easily tantamount to saying it's impossible/improbable