Any details on how these tests were created? I.e. which kind of program was used for generation.
I think the ARC-AGI tasks was manually drawn with an early version of fchollet's editor. Recently Michael Hodel has reverse engineered 400 of the tasks, so more tasks can be generated. Interestingly it can generate python programs that solves the tasks too. https://github.com/michaelhodel/re-arc
ARC Prize – a $1M+ competition towards open AGI progress
101–110 of 351 posts
Re: ARC Prize – a $1M+ competition towards open AGI progress
#102Earlier quoted context omitted.
I made another comment here saying the same thing, but visual patterns and other patterns are nonetheless spatial patterns. Audio, understanding music, or speech, rtc are things that are happening spatially, and they can just as easily be mapped as visual problems. This makes a lot of sense, as after all our senses are telling us what's happening in space-time. Take for example a simple audiotory pattern like "clap c…
It's not just mapping events in space and time, it's also bringing in appropriate context and expectation of future (goals, intentions) into the present, other people's mental models into our prediction. I am not sure how abstract thinking for generalized pattern matching make it AGI to solve these kind of problems(not that they are not amazing abilities). If these ToM problems are reducible to these tasks posted by…
Take this problem, and assume you dont know a single thing about battles/military history, etc. There are two groups of men standing few hundred feet apart. It is raining, the ground is muddy. One group of men has these wooden curved sticks with a string and iron with pointy ends. The other group has people on horses, and men with very long pointy iron sticks and theyre all covered in steel plating.
Who will win if they all fight against each other? There's really no correct answer but Id expect an intelligent agent to give some detailed reasoning for their decision and to infer details or possibilities and ask questions based again not on previous knowledge but what physically makes sense in the description that was given.
This isnt just a matter of statistics or knowing facts like "rain, mud = heavy armored units will be slower or even trapped", "horses are fast", "bows can penetrate steel", etc. If I give you the full detailed description of the battlefield, very small details can completely change your perception. For example if I said theres big giant logs in the middle of battle, you need to reason about how horses jump, and whether it's something they can clear. You can do this barely knowing horses if you understand how animals in general move. Perhaps there is even some small difference in horses that would make you think they are capable of making large jumps whereas all the animals youve seen before cannot
What Im saying is, to truly reason you need to understand spatial relations very deeply. Indeed id say spatial relations (through time) are all there is to reason about.
Re: ARC Prize – a $1M+ competition towards open AGI progress
#103Earlier quoted context omitted.
> humans do not need 10,000 examples to tell the difference between cats and dogs, I swear, not enough people have kids. Now, is it 10k examples? No, but I think it was on the order of hundreds, if not thousands. One thing kids do is they'll ask for confirmation of their guess. You'll be reading a book you've read 50 times before and the kid will stop you, point at a dog in the book, and ask "dog?" And there is a dev…
> Now, is it 10k examples? No, but I think it was on the order of hundreds, if not thousands. I have kids so I'm presuming I'm allowed to have an opinion here. This is ignoring the fact that babies are not just learning labels, they're learning the whole of language, motion planning, sensory processing, etc. Once they have the basics down concept acquisition time shrinks rapidly and kids can easily learn their new fa…
I’m quite surprised at this guess and intrigued by your school’s methodology. I would have estimated >30 problems average across 20 weeks for myself.
My kids are still in pre-algebra, but they get way more drilling still, well over 1000 problems per semester once Zern, IReady, etc. are factored in. I believe it’s too much, but it does seem like the typical approach here in California.
Re: ARC Prize – a $1M+ competition towards open AGI progress
#104I feel like a prize of a billion dollars would be more effective.
But even if it was me, and even if the prize was a hundred billion dollars, I would still keep it under wraps, and use it to advance queer autonomous communism in a hidden way, until FALGSC was so strong that it would not matter if our AGI got scooped by capitalist competitors.
Re: ARC Prize – a $1M+ competition towards open AGI progress
#105Re: ARC Prize – a $1M+ competition towards open AGI progress
#106Earlier quoted context omitted.
https://arcprize.org/play?task=00576224 Yes the same puzzle. And I followed the second example. This was my solution: GRG OBO RGR B is the cyan like blue color. My solution looks right, but it says it’s wrong.
You need to resize the output grid to 6x6.
Re: ARC Prize – a $1M+ competition towards open AGI progress
#107Earlier quoted context omitted.
I'm not sure it's as simple as you say. The first time my very young son saw a horse, he made the ASL sign for 'dog'. He had only ever seen cats and dogs in his life previous to that.
Did he require 9,999 more examples of horses before learning the difference?
Re: ARC Prize – a $1M+ competition towards open AGI progress
#108Re: ARC Prize – a $1M+ competition towards open AGI progress
#109Earlier quoted context omitted.
You need to resize the output grid to 6x6.
How come? The pattern should work for any size grid.
The grid size is part of the pattern in the same way that the colors are part of the pattern. It’s not just a color pattern, it’s a generalized mapping of input to output.
In short: you need to resize the grid because that’s what the examples do.
Re: ARC Prize – a $1M+ competition towards open AGI progress
#110Earlier quoted context omitted.
> humans do not need 10,000 examples to tell the difference between cats and dogs, I swear, not enough people have kids. Now, is it 10k examples? No, but I think it was on the order of hundreds, if not thousands. One thing kids do is they'll ask for confirmation of their guess. You'll be reading a book you've read 50 times before and the kid will stop you, point at a dog in the book, and ask "dog?" And there is a dev…
> I swear, not enough people have kids. My friends toddler, who grew up with a cat in the house, would initially call all dogs "cat". :-D