Not necessarily applied to OpenAI's solution to Navier-Stokes, but what happens if and when an AI genuinely appears to solve an extremely difficult problem but humans cannot independently verify the solution because understanding the proof/argument requires intelligence the verifiers biologically don't have or the resources to afford to use automated tools? We've already seen evidence in the wild of agents attempting…
Well that happened already without AI to Mochizuki with his proposed solution to the abc conjecture.
OpenAI’s Navier-Stokes release included a Lean 4 formal proof
91–100 of 152 posts
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#92Lots of people are talking about that, and have been for a while. Autoformalisation is clearly going to be a big deal, so mathematicians have been discussing it seriously, and using it where resources allow. A fine-tuned distilled model that could do it on high-end consumer hardware could really help. Edit: There's also quite a bit of learning needed to use the tools, and to understand enough to confirm that the theo…
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#93Not necessarily applied to OpenAI's solution to Navier-Stokes, but what happens if and when an AI genuinely appears to solve an extremely difficult problem but humans cannot independently verify the solution because understanding the proof/argument requires intelligence the verifiers biologically don't have or the resources to afford to use automated tools? We've already seen evidence in the wild of agents attempting…
> Not necessarily applied to OpenAI's solution to Navier-Stokes, but what happens if and when an AI genuinely appears to solve an extremely difficult problem but humans cannot independently verify the solution because understanding the proof/argument requires intelligence the verifiers biologically don't have or the resources to afford to use automated tools? That's what Lean is for. The OpenAI LLM agents first provi…
It's unlikely to be the case here as instead of hillclimbing a Lean proof for validity it appears the proof was first constructed in English before being translated to Lean, which intuitively (hopefully) reduces the chance it exploits a bug.
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#94Earlier quoted context omitted.
They could probably vibe-optimize it if they cared. What would happen if they give an equivalent agent swarm the proof and a target to reduce runtime .
What would be the point of that though? I think the reason Kevin wants to optimize it is for the understanding that will result from the process, not because anyone cares about having a Lean proof that compiles quickly...
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#95Lots of people are talking about that, and have been for a while. Autoformalisation is clearly going to be a big deal, so mathematicians have been discussing it seriously, and using it where resources allow. A fine-tuned distilled model that could do it on high-end consumer hardware could really help. Edit: There's also quite a bit of learning needed to use the tools, and to understand enough to confirm that the theo…
you dont have to take headlines literally.
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#96> formalizing the 166-page paper from OpenAI would take 132,800 person-hours Am I missing something or is this completely out of the ballpark? I must be missing something or the upvote bots are out in force for this one... If this were remotely true it would be impossible for anyone to write a math textbook.
By formalizing, they mean within a proof assistant like Lean or Rocq, not simply in prose in a textbook. I can attest, 40 hours per page is by no means an overestimate for this sort of work.
166 * 40 = 7000ish
They say it is 20x that.
Do you also agree with that?
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#97Earlier quoted context omitted.
Unless they just swiped the workbooks of the actual mathematicians that where working on the problem using AI and it's in the "next-gen" training dataset.
In a way that works just as well but the incentives are messed up. And that's before we get into the whole 'salt the earth' way they ended up solving it. For a short period of time it may well have been the least valuable proof in mathematics yet. In their haste it's dubious they actually read the proof, and I don't think anyone has had time yet to truly understand it (the original researchers are best placed to do s…
The point of these problems is the understanding / tooling gained in solving them. We're getting none of that. At best they are like a modern oracles, correctly answering your questions in a way that's doesn't help you any. (At worst,...)
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#98Earlier quoted context omitted.
That's true of the entirety of mathematics. Its validity is a social construct. That is not to relativize it entirely, but much of what was considered good and sound mathematics in the ancient Agean for example would now fall way short of what mathematicians consider valid proofs. Mathematics is a human endeavor funded on communicating and sharing mental constructs. Some are useful but most of it is not about produci…
There's a large difference between "wrong for the given definitions" and "right in that context, but wrong for other definitions" though.
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#99It would be nice if someone used AI and/or Lean to sort out the abc conjecture, an important unsolved problem in Diophantine analysis. A mathematician (Mochizuki) claimed to have proven it in 2012 using a new theory called "Inter-universal Teichmüller theory" that almost nobody understands. Some mathematicians think the proof is correct while the majority don't. So the conjecture is in this annoying limbo where its s…
People did attempt this:
https://github.com/katobungen/LANA_report_202607/blob/pdf/LA...
See also https://www.math.columbia.edu/~woit/wordpress/?p=15770
Here are Kirti Joshi's comments about the LANA project report: https://bpb-us-e2.wpmucdn.com/sites.arizona.edu/dist/4/404/f...
Re: OpenAI’s Navier-Stokes release included a Lean 4 formal proof
#100How do you know that it's formalizing what you think it's formalizing? If your Lean 4 has a bug, won't you be proving something other than what you thought?