For anyone using LLMs heavily for coding, this shouldn't be too surprising. It was just a matter of time. Mathematicians make new discoveries by building and applying mathematical tools in new ways. It is tons of iterative work, following hunches and exploring connections. While true that LLMs can't truly "make discoveries" since they have no sense of what that would mean, they can Monte Carlo every mathematical tool…
There is a long and interesting recent essay on that topic by a mathematician: https://davidbessis.substack.com/p/the-fall-of-the-theorem-e...
An OpenAI model has disproved a central conjecture in discrete geometry
141–150 of 1001 posts
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#142Re: An OpenAI model has disproved a central conjecture in discrete geometry
#143Ask an LLM to invent a new word and post it here. You will see that it simply combines words already in the training data.
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#144Re: An OpenAI model has disproved a central conjecture in discrete geometry
#145Earlier quoted context omitted.
Afaik this is because there is a community and database around them.
Interesting. OpenAI could also be trying to solve other problems, but Erdos problems maybe falling first?
1. They have a wide range of difficulties. 2. They were curated (Erdos didn't know at first glance how to solve them). 3. Humans already took the time to organize, formally state, add metadata to them. 4. There's a lot of them.
If you go around looking for a mathematics benchmark it's hard to do better than that.
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#146As I have stated before, AI will win a fields medal before it can manage a McDonald's A difficult part was constructing a chess board on which to play math (Lean). Now it's just pattern recognition and computation. LLMs are just the beginning, we'll see more specialized math AI resembling StockFish soon.
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#147To the “LLMs just interpolate their training data” crowd: Ayer, and in a different way early Wittgenstein, held that mathematical truths don’t report new facts about the world. Proofs unfold what is already implicit in axioms, definitions, symbols, and rules. I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. So either “recombining existing material” isn…
You can watch a rock roll down a hill and derive the concept for the wheel.
Seems pretty self evident to me
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#148Earlier quoted context omitted.
Not only it supercharged science it supercharges scientist. Research on any narrow topic is a different world now. Agents can read 50 papers for you and tell you what's where. This was impossible with pure text search. Looking up non-trivial stuff and having complex things explained to you is also amazing. I mean they don't even have to be complex, but can be for adjacent field where these are basics from the other f…
It's a very heavy hammer. I used it in the way you describe and after double-checking noticed some crucial details were missed and certain facts were subtly misrepresented. But I agree with you, especially in areas where they have a lot of training data, they can be very useful and save tons of time.
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#149See the longstanding debate on whether new math is "invented" or "discovered". Most mathematicians I knew thought it's discovered.
Re: An OpenAI model has disproved a central conjecture in discrete geometry
#150To the “LLMs just interpolate their training data” crowd: Ayer, and in a different way early Wittgenstein, held that mathematical truths don’t report new facts about the world. Proofs unfold what is already implicit in axioms, definitions, symbols, and rules. I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. So either “recombining existing material” isn…
Cracks me up.
What exactly do we think that human brains do?