Live data from Hacker News

An OpenAI model has disproved a central conjecture in discrete geometry

openai.com

231–240 of 1001 posts

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#231

To the “LLMs just interpolate their training data” crowd: Ayer, and in a different way early Wittgenstein, held that mathematical truths don’t report new facts about the world. Proofs unfold what is already implicit in axioms, definitions, symbols, and rules. I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. So either “recombining existing material” isn…

I'm not sure how feasible this is, but I love the thought experiment of limiting a training set to a certain time period, then seeing how much hinting it takes for the model to discover things we already know.

E.g. training on physics knowledge prior to 1915, then attempting to get from classical mechanics to general relativity.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#232
Speaking as a postdoc in math, I must say that this is rather exciting. This is outside of my field, but the companion remarks document is quite digestible. It appears as though the proof here fairly inspired by results in literature, but the tweaks are non-trivial. Or, at least to me, they appear to be substantial to where I would consider the entire publication novel and exciting.

Many of my colleagues and I have been experimenting with LLMs in our research process. I've had pretty great success, though fairly rarely do they solve my entire research question outright like this. Usually, I end up with a back and forth process of refinements and questions on my end until eventually the idea comes apparent. Not unlike my traditional research refinement process, just better. Of course, I don't have access to the model they're using =) .

Nevertheless, one thing that struck me in this writeup, was the lack of attribution in the quoted final response from the model. In a field like math, where most research is posted publicly and is available, attribution of prior results is both social credit and how we find/build abstractions and concentrate attention. The human-edited paper naturally contains this. I dug through the chain-of-thought publication and did actually find (a few of) them. If people working on these LLMs are reading, it's very important to me that these are contained in the actual model output.

One more note: the comments on articles like these on HN and otherwise are usually pretty negative / downcast. There's great reason for that, what with how these companies market themselves and how proponents of the technology conduct themselves on social media. Moreover, I personally cannot feel anything other than disgust seeing these models displace talented creatives whose work they're trained on (often to the detriment of quality). But, for scientists, I find that these tools address the problem of the exploding complexity barrier in the frontier. Every day, it grows harder and harder to contain a mental map of recent relevant progress by simple virtue of the amount being produced. I cannot help but be very optimistic about the ambition mathematicians of this era will be able to scale to. There still remain lots of problems in current era tools and their usage though.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#233

To all AI skeptics: What is preventing AI from continuing to improve until it is absolutely better than humans at any mental task? If we compare AI now vs 2022 the difference is outstandingly stark. Do you believe this improvement will just stop before it eclipses all humans in everything we care about?

You should really look up a video about what GPTs fundamentally are.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#234

One thing seems for certain is that OpenAI models hold a distinct lead in academics over Anthropic and Google models. For those in academics, is OpenAI the vendor of choice?

From my limited testing, Gemini can dig out hard to find information given you detail your prompt enough. Given that Google is the "web indexing company", finding hard to find things is natural for their models, and this is the only way I need these models for. If I can't find it for a week digging the internet, I give it a colossal prompt, and it digs out what I'm looking for.

This is my experience too. Gemini and Gemini deep research are awesome. Claude's deep research is pretty bad really relative to ChatGPT or Gemini. Overall, I still love Claude the best but it is not what I would want to use if I wanted to really dig into deep research. The export to google docs in Gemini deep research is tough to beat too. I haven't used Gemini since January but have probably years of material from saved deep research in google docs. Almost an overwhelming amount of information when I dive into what I saved.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#235

To the “LLMs just interpolate their training data” crowd: Ayer, and in a different way early Wittgenstein, held that mathematical truths don’t report new facts about the world. Proofs unfold what is already implicit in axioms, definitions, symbols, and rules. I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. So either “recombining existing material” isn…

"LLMs just interpolate their training data" Cracks me up. What exactly do we think that human brains do?

[deleted]

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#236

Earlier quoted context omitted.

I absolutely believe that AI will supercharge science and replace humans. Why shouldn't it? Humans are poorly optimized for almost anything, and built on a substrate that's barely hanging together

Well, for starters AI doesn't have goals. If there was a super intelligence with goals, why would they work for us?

Fwiw if you trained an LLM in an RL sandbox that would require it to have goals, the output llm probably would "have goals"

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#237
post #61

Earlier quoted context omitted.

> I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. Most discoveries are indeed implied from axioms, but every now and then, new mathematics is (for lack of a better word) "created"—and you have people like Descartes, Newton, Leibniz, Gauss, Euler, Ramanujan, Galois, etc. that treat math more like an art than a science. For example, many belive that to…

Creation is done by humans who have been trained on the data of their life experiences. Nothing new is being created, just changing forms. A scientist has to extract the "Creation" from an abstract dimension using the tools of "human knowledge". The creativity is often selecting the best set of tools or recombining tools to access the platonic space. For instance a "telescope" is not a new creation, it is recombinati…

that’s why we say that with such discoveries we receive a new way – of looking, of doing, of thinking… these new paths preexist in the abstract, but they can be taken only when they’ve been opened. and that is as good as anything “new” gets. (and such discoveries are often also inventions, for to open them, a ruse is needed to be applied in a specific way for the way to open).

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#238
post #224

The proof brings unexpected, sophisticated ideas from algebraic number theory to bear on an elementary geometric question. The more I read about these achievements the more I get a feeling that a lot of the power of these models comes from having prior knowledge on every possible field and having zero problems transferring to new domains. To me the potential beauty of this is that these tools might help us break thro…

I’ve always been skeptical about the role of LLMs in mathematics, but this is the first time I’ve seen this argument, and I actually find it very compelling. Maybe LLMs will help us develop more horizontal understanding of the field.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#239
post #225

To the “LLMs just interpolate their training data” crowd: Ayer, and in a different way early Wittgenstein, held that mathematical truths don’t report new facts about the world. Proofs unfold what is already implicit in axioms, definitions, symbols, and rules. I think that idea is deeply fascinating, AND have no problem that we still credit mathematicians with discoveries. So either “recombining existing material” isn…

There is a creational aspect in math - definitions and rules are created.

And this is one of the many issues with invoking the logical positivists here...

I'm not even sure why they were invoked. Even disregarding the big techinical debunks such as two dogmas, sociologically and even by talking to real mathematicians (see Lakatos, historically, but this is true anecdotally too), it's (ironically) a complete non-question to wonder about mathematics in a logical positivist way.

Re: An OpenAI model has disproved a central conjecture in discrete geometry

#240

For anyone using LLMs heavily for coding, this shouldn't be too surprising. It was just a matter of time. Mathematicians make new discoveries by building and applying mathematical tools in new ways. It is tons of iterative work, following hunches and exploring connections. While true that LLMs can't truly "make discoveries" since they have no sense of what that would mean, they can Monte Carlo every mathematical tool…

> the result has no meaning without the human intent behind the objective, human understanding to value the new pathway the AI used (more valuable than the result itself, by far) and the mathematical language (built by humans) to explore the concept. Isn't this just anthropocentrism? Why is understanding only valid if a human does it? Why is knowledge only for humans? If another species resolved the contradictions be…

It's a bit of an "if a tree falls in the forest but nobody hears it, does it make a sound?" quandary. Sure, maybe some aliens in a distant galaxy understand quantum mechanics better than we do. That's great, but it has no bearing on our little bubble of existence.

Though perhaps more to your point, if some superhuman AI is developed, and understands things better than us without telling us about it (or being unable to), it could perform feats that seem magical to us — that would concern us even if we don't understand it, since it affects us.

But I think in the frame of reference of the commenter you were replying to, they're just saying that the low-level AI used in this specific case is not capable of making its results actually useful to us; humans are still needed to make it human-relevant. It told us where to find a gem underground, but we still had to be the ones to dig it out, cut it, polish it, etc.

Post reply on HN