Earlier quoted context omitted.
Whenever there is a breaking AI-generated proof, it's the job of actual leading mathematicians to formalize/check it . Laypeople are not checking or writing these AI-assisted proofs. Even when Lean is used, it's mathematicians writing these proofs and checking if the formalization was done right. Terrance Tao's career trajectory has reached new highs due to AI. He's more relevant than ever. This is the exact opposite…
honestly curious question: do you expect this to remain true? If so, for how long? I can think of two potential reasons why it might not stay true. 1. The very best humans remain able to understand/check the proofs, but we go for so long with every proof checking out that society more broadly just decides to trust. We are already doing that with human mathematicians. I can't verify what Terence Tao tells me is correc…
For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.
Regarding 1, the same is true of every other scientific field. Verifying some tidbit of knowledge for yourself as an individual isn’t optimally useful in all circumstances.
Regarding 2, if the proof isn’t understandable then it probably isn’t useful. Many people today work in the hypothetical world where the Riemann Hypothesis is true, and many work in the hypothetical world where it is false. If it takes decades to validate that some horrifically complex AI proof of either fork is true, people will probably continue working on the other fork just in case.