OpenAI O3 breakthrough high score on ARC-AGI-PUB

#1

Post by maurycy » Fri, Dec 20, 2024, 6:11 PM UTC

Re: OpenAI O3 breakthrough high score on ARC-AGI-PUB

#2

Post by [deleted] » Fri, Dec 20, 2024, 6:13 PM UTC

[deleted]

#3

Post by [deleted] » Fri, Dec 20, 2024, 6:16 PM UTC

[deleted]

#4

Post by razodactyl » Fri, Dec 20, 2024, 6:18 PM UTC

Great. Now we have to think of a new way to move the goalposts.

#5

Post by famouswaffles » Fri, Dec 20, 2024, 6:19 PM UTC

This is also wildly ahead in SWE-bench (71.7%, previous 48%) and Frontier Math (25% on high compute, previous 2%).

So much for a plateau lol.

#6

Post by tines » Fri, Dec 20, 2024, 6:19 PM UTC

razodactyl wrote: post #4

Great. Now we have to think of a new way to move the goalposts.

I mean, what else do you call learning?

#7

Post by [deleted] » Fri, Dec 20, 2024, 6:20 PM UTC

[deleted]

#8

Post by maxdoop » Fri, Dec 20, 2024, 6:20 PM UTC

How much longer can I get paid $150k to write code ?

#9

Post by braden-lk » Fri, Dec 20, 2024, 6:22 PM UTC

If people constantly have to ask if your test is a measure of AGI, maybe it should be renamed to something else.

#10

Post by [deleted] » Fri, Dec 20, 2024, 6:22 PM UTC

razodactyl wrote: post #4

Great. Now we have to think of a new way to move the goalposts.

[deleted]