Live data from Hacker News

AI solves International Math Olympiad problems at silver medal level

deepmind.google

471–480 of 564 posts

Re: AI solves International Math Olympiad problems at silver medal level

#471

Earlier quoted context omitted.

No. Funny how these discussions too often devolve into semantics lol.

Funny how people don't understand basic logic. If it is a proof in a logic, and the machine checked that proof, it is a proof, no matter that no human actually understands it. A human doesn't need to understand the proof, they just have to understand why the proof is a proof.

Well... assuming a human made no mistakes setting up that logic.

Re: AI solves International Math Olympiad problems at silver medal level

#472

This means we may need to remove or replace the Olympiad..It has no practical significance..Winners never contributed to any major scientific breakthroughs.

A lot of them become Fields medallists. From [1] "The conditional probability that an IMO gold medalist will become a Fields medalist is fifty times larger than the corresponding probability for a PhD graduate from a top 10 mathematics program."

[1]: https://www.aeaweb.org/articles?id=10.1257/aeri.20190457

Re: AI solves International Math Olympiad problems at silver medal level

#473

Earlier quoted context omitted.

Funny how people don't understand basic logic. If it is a proof in a logic, and the machine checked that proof, it is a proof, no matter that no human actually understands it. A human doesn't need to understand the proof, they just have to understand why the proof is a proof.

Well... assuming a human made no mistakes setting up that logic.

Of course. That falls under "understanding why the proof is a proof".

Re: AI solves International Math Olympiad problems at silver medal level

#474

> ... but whenever IMO is brought up, a caveat should be put out: medals are awarded to 50% of the participants (high school students), with 1:2:3 ratio between gold, silver and bronze. That puts all gold and silver medalists among the top 25% of the participants. yes, it is true, but getting to the country specific team is itself an arduous journey, and involves brutal winnowing every step of the way f.e. regional m…

Some countries pull these kids out of school for an entire year to focus on training for it, while guaranteeing them entry into their nation's top university.

Source: a friend who got silver on the IMO

Re: AI solves International Math Olympiad problems at silver medal level

#475
post #273

Earlier quoted context omitted.

> Everyone's busy watching Magnus Carlsen. Actually, I was looking up Elo ratings of the top computer chess players, and learned that it is not that trivial to compare these, due to differences in hardware requirements and whatnot.

Are you arguing computer chess players are as popular as human chess players?

Not at all. I just tripped over your black-and-white presentation of things, and thought it might be helpful to provide some counterbalance.

Re: AI solves International Math Olympiad problems at silver medal level

#476
post #33

This is the real deal. AlphaGeometry solved a very limited set of problems with a lot of brute force search. This is a much broader method that I believe will have a great impact on the way we do mathematics. They are really implementing a self-feeding pipeling from natural language mathematics to formalized mathematics where they can train both formalization and proving. In principle this pipeline can also learn bas…

People are already working on this

https://leandojo.org/

https://machine-learning-for-theorem-proving.github.io/

https://www.youtube.com/watch?v=P5ew0BrRm_I

https://paperswithcode.com/task/automated-theorem-proving

https://old.reddit.com/r/math/comments/11mb9lx/future_of_aut...

https://github.com/RiccardoBiosas/LeanGPT

Re: AI solves International Math Olympiad problems at silver medal level

#477
post #354

Earlier quoted context omitted.

… no? After the LaTeX output, I told stock GPT4o that the answer was "all even integers", and asked for the statement in Lean. I had to make two changes to its output (both of which were compile-time errors, not misformalisations), and it gave me the formalisation of the difficult direction of the problem. Both changes were trivial: it had one incorrect (but unnecessary) import, and it used the syntax from Lean 3 ins…

> I am quite confident that this formalisation failure mode is not hard to solve in a system that is, like, actually trained to do this. Why?

This is really not the kind of problem LLMs are bad at! But since you insist, given the LaTeX, Claude 3.5 Sonnet correctly stated the theorem in full while inventing notation for the floor operation (it did correctly note unprompted what the right function was and how to obtain it from mathlib, but it incorrectly attempted to define syntax sugar for it).

Re: AI solves International Math Olympiad problems at silver medal level

#478
post #392

Earlier quoted context omitted.

Link isn't working for me can you summarize. What i heard ten years ago was that 1pt is quite common for a significant progress

Yeah, the progress has to be quite significant, no points are awarded for trivial observations. Thus scores are usually bimodal around 0 and 7. In the linked stats you can see that 1 point for P3/P5 was less common than full score on other problems.

Problem 2 and 5 have a lot of 1s. Sometimes thre is an interesting advance that is easirr than the full solution. Also in problem 6 the only hope for most was to get that 1 point.

Re: AI solves International Math Olympiad problems at silver medal level

#479

Earlier quoted context omitted.

Only slightly more general. It only works for games that are zero-sum, deterministic, have no hidden information, and discrete game state and moves. Other examples include connect-4.

So finding Lean proofs can be conceptualized as a zero-sum game? Another basic requirement is that valid moves / inference steps and the winning condition can be efficiently verified using some non-AI algorithm. Otherwise there would not be a reward signal for the reinforcement learning algorithm. This is different from answering most natural language questions, where the answer can't be checked trivially.

I don't think AlphaZero is related to this work, apart from both being NN-based. AlphaZero and its training pipeline fundamentally only works for "chess-like" two-player games, where the agent can play against itself and slowly improve through MCTS.
Post reply on HN