I'm a mathematician and I'm not sure one should believe those results right now.. An automatic formalization requires a system of logic rules to be applied, which is not something LLMs are great at (remember the Apple paper a while ago?). I'm very curious to see how the community will react after the initial hype.. so far, it's being quite disappointing..
Formalizing Fermat's Last Theorem
431–440 of 531 posts
Re: Formalizing Fermat's Last Theorem
#432Earlier quoted context omitted.
The answer is we don't really know [0]: > In 2026, AIs designed to spot bugs in software were directed at Lean, and found several loopholes which were then fixed. Perhaps related to this effort, a purported disproof of the Collatz conjecture was announced as verified in Lean. However, this proof was soon determined to rely on a bug in Lean, and once the bug was fixed the proof was found invalid However it's a bit dif…
What are the chances that a small C program uncovers a bug in the C compiler, maybe in its type checker? What are the chances that a very large C program uncovers a bug in the C compiler?
Re: Formalizing Fermat's Last Theorem
#433Earlier quoted context omitted.
In lean, a theorem is specified by a type (in their highly complex "dependent type system") and proof is specified by a code that produces a term of that type. If the compiler certifies that the code indeed produces a term of that type, then the proof is correct. So, only need to trust: (1) That theorem statement is correctly encoded (FLT has a very short 1 liner description really) (2) Lean compiler is correct
What if the mathematical objects are not encoded "correctly"? For example, everyone knows that the natural numbers and simple data structures like lists or trees can be encoded with inductive types, but what about the new objects introduced by the proof?
Re: Formalizing Fermat's Last Theorem
#434> Along the way, it wrote 13 million lines of Lean and proved 29,500 intermediate theorems. Pretty insane. I suppose it lends further credence to the idea that anything that can be shown to be correct can be done by a model.
The next step, if Anthropic is interested, is definitely performing refactoring to cut down on the size of the proof. It’s clear to everyone including Anthropic that this proof isn’t as concise as it could have been. When it’s concise enough to be accepted into Mathlib is when victory truly is upon us.
Re: Formalizing Fermat's Last Theorem
#435Earlier quoted context omitted.
If AI manages to prove, or disprove, I wonder what would Clay Foundation do for the prize.
Who cares about some billionaire paying another billionaire a million dollars? WHat matters is our understanding of maths, and whether this sort of thing makes us smarter or stupider.
Re: Formalizing Fermat's Last Theorem
#436Earlier quoted context omitted.
Most of the kids in history died before age 5. Child mortality is very low now compared to the past, thanks to the modern medicine and technology. I am glad humanity "played God", and reduced this unnecessary child suffering.
They didn't die of senescence.
Re: Formalizing Fermat's Last Theorem
#437Earlier quoted context omitted.
What if the mathematical objects are not encoded "correctly"? For example, everyone knows that the natural numbers and simple data structures like lists or trees can be encoded with inductive types, but what about the new objects introduced by the proof?
that's something a human needs to do, and it's non trivial, but it's a simple task compared to checking the correctness of the proof. in any case, most of the language is probably already defined in Lean and checked independently by many people.
Re: Formalizing Fermat's Last Theorem
#438Re: Formalizing Fermat's Last Theorem
#439Earlier quoted context omitted.
a) classic goodhart is using gdp as a measure of prosperity. the government sets a prosperity target. to increase prosperity the government makes workers increase gdp by working 16 hours per day. gdp increases. prosperity is up! the metric is now poisoned. b) how and why could human welfare get worse in a growing economy, really the list is long. one example, unsustainable industries grow but do not create surplus. t…
A) that's a bad model to think. You are of the mind that working more hours is the only way to measure gdp whereas increase in productivity with tools like AI, machinery, tech etc can act as a multiplier. So this way you are conflating bad ways to increase gdp with good ways like AI. That's how US is powerhouse as they are basically a technological hub of the world. B) ha? More fish means couple of things.. they're a…
nonetheless thank you for sharing a rejoinder.
Re: Formalizing Fermat's Last Theorem
#440Earlier quoted context omitted.
And human salaries for those who worked on the prover harness etc. which isn't just standard Fable. It also uses Prove2Me, which uses a graph like previous automated theorem provers. A fact that LLM hawks have categorically denied here before, with opposition naturally flagged. Now they have it in writing.
> A fact that LLM hawks have categorically denied here before, with opposition naturally flagged. Yeah, because before now there's been literally zero proof of an automated theorem prover scaffold around the LLMs being used, and big counterexamples and such being found, with raw chat logs available, where no such thing was used. > Now they have it in writing. Yeah, because now it's actually being done . They talk abo…
They all steal from ACL2 without attribution in the current publication boiler room atmosphere. They get away with it because the AI Cult has information and publication dominance.
There was a brief period that used only language for toy IMO problems, but for serious work like FLT they apparently reverted to established approaches.