Quite shocked that O1-Pro isn't orders of magnitude better than O1 despite being 10x the price.
Cool benchmark nonetheless!
AI Does NYT Connections
21–22 of 22 posts
Re: AI Does NYT Connections
#22Why is Gemini given 4 Xs for #547? It has "Group 3" correct. It should be marked as having 1/4 groups correct. Same thing happened on #535, Gemini actually got "Group 1" correct but was marked 0/4 correct.
Looks like this was fixed, thanks!