Live data from Hacker News

Mathematicians issue warning as AI rapidly gains ground

science.org

101–110 of 366 posts

Re: Mathematicians issue warning as AI rapidly gains ground

#101

> AI-generated papers could overwhelm peer-review systems with low-quality work That's not a problem unique to math, or even to academia. It's a problem in every context in human life where people communicate via written documents.

It is potentially worse with math because accuracy is much more important and there are fewer reviewers compared to other fields.

It will drive math journals to require formalization of the proofs in the supplemental material.

Re: Mathematicians issue warning as AI rapidly gains ground

#102

Earlier quoted context omitted.

To further this assertion, there is almost no value to deeply esoteric math that is technically correct, but completely inapplicable to any scientific reality, and completely unintelligible to humans. Consider these findings deep, dark corners in the unfathomably large hyperspace of mathematics. My guess is AI will be incredibly adept at identifying these types of findings, and it will be exceedingly difficult for hu…

Sorry but I couldn't agree less. Deep esoteric research and trivial looking boring research can be as useful as state of the art trending areas. "Jobs for nerds" as has been stated, has given surprising and unexpected advances, or leveraged incredible advancements. An standard and boring bacteria in a specific Spanish biome, gave us CRISPR-Cas. There ar hundreds of examples. True knowledge is, and will be, a human en…

> Sorry but I couldn't agree less.

> …

> True knowledge is, and will be, a human endeavor, deiven by human curiosity. Promoting curiosity is the sign of a developed society.

Unless I misunderstand, it sounds like you do agree? My point is that without human mathematicians LLM output is meaningless, and without human mathematicians holding the reins, LLMs would probably quickly devolve into “proving” things that are not only completely unintelligible by humans, but have no utility.

Your examples of esoteric mathematical concepts are anecdata. The vast majority of esoteric mathematics does not have utility. Mathematics is an incredibly large space of concepts. Consider the number of provable theorems in number theory alone, perhaps even related to specific subsets and sequences of numbers. The vast majority of the findings in that domain will not be isomorphic to some real world problem, they will be trivia.

We will need mathematicians to separate the signal from the noise.

Re: Mathematicians issue warning as AI rapidly gains ground

#103
post #6

I'm curious about whether we will start discovering new maths in the next few years that provide insight into unsolved CS or Physics problems!

I think it's going to reduce the friction of exploring new areas in math, and that we're going to see a golden age of math unlike anything seen before.

Re: Mathematicians issue warning as AI rapidly gains ground

#104

This is all contingent on AI forays into mathematics being slop and low quality. However it's clear that recent AI models are capable of genuine mathematical achievements which surpass the frontier of what humans are able to accomplish (wrt the unit distance Erdos problem). The issue is, how is a group of intellectuals, whose identity derives from their ability to do something rare, useful, and requires many years to…

> This is all contingent on AI forays into mathematics being slop and low quality

It's literally a set of recommendations for researchers on how to use AI to advance the field and prevent slop from overwhelming the people who might do anything with the research produced.

For people who are so eager to declare that everyone else is just having an existential crisis because "your culture is commodified", AI people are getting awfully defensive about this document.

Re: Mathematicians issue warning as AI rapidly gains ground

#105
post #90

Another mathematician already predicted this, but you didn't listen. His name was Theodore Kaczynski. It's time to reap what you've sown.

I think plenty of people "listened." But what was his plan and how would you have proposed implementing it?

It's obvious what his plan was: blow up key people until the dark future was averted.

Re: Mathematicians issue warning as AI rapidly gains ground

#106
post #25

> However, the declaration argues math is more than a machine for producing correct answers. There might be more to maths than that, but that is definitely the most important part. I love science funding. But not because it's a jobs program for nerds.

The most important part of math is advancing human understanding. A correct answer by itself is not as important as understanding why it is correct.

The value of human understanding just cratered because we have machines to understand for us now.

Re: Mathematicians issue warning as AI rapidly gains ground

#107

Accelerationists may argue that the eroding of proper attribution and proof verification by humans is a meaningless short term struggle of a dying field. Mathematics seems to be entering an era where human + machine maximizes performance, much like chess in the 1990s. However, imagine a future where even talented mathematicians are nothing but noise in the machine (as is the case in chess now). A future where AI gene…

An issue I see is who controls the information. The next generation may not recieve the knowledge, it may be gatekept by industry who *will* own the gate.

The future may not have access unless we fight to ensure they do. This is how I read the article.

Re: Mathematicians issue warning as AI rapidly gains ground

#108
post #48

Much of math (or science) research has the strange quality of being mostly curiosity-driven, but having giant benefits that occasionally spin out to the public. Some questions are more urgent and practical. My feeling is that the more directly practical a question is, the more likely the research community is to support AI usage in that question. The annoying thing about recent AI advances is that they target questio…

That's an interesting perspective and I wholly disagree with the conclusion You are saying that tough problems with no applicability are useful because people that you happen to respect got good by their curiosity and pursuit of trying to solve these kinds of problems and failing, but branching off into other cognitive areas as mathematicians Now if I know anything about math for the sake of math, and academics, thes…

I think you've slightly straw manned the lamentation there. Not that I agree with the lamentation, but using your talent to make the rich richer (which is what quants do, they are paid a fixed amount to provide a larger value up the chain), as opposed to advancing human knowledge, is the reason for the lament, not some sort of respectability issue.

Re: Mathematicians issue warning as AI rapidly gains ground

#109
post #25

Earlier quoted context omitted.

The most important part of math is advancing human understanding. A correct answer by itself is not as important as understanding why it is correct.

To further this assertion, there is almost no value to deeply esoteric math that is technically correct, but completely inapplicable to any scientific reality, and completely unintelligible to humans. Consider these findings deep, dark corners in the unfathomably large hyperspace of mathematics. My guess is AI will be incredibly adept at identifying these types of findings, and it will be exceedingly difficult for hu…

Your model of what AI is good at is wrong. Generative AI is not good at wandering off into novel esoteric abstract corners while maintaining correctness, it is good at things that are close to its training data. I suspect that humans will long outperform AI in the domain of "novel esoteric abstract useless math" whereas AI will outperform humans in the domains of (1) making connections between already-well-understood concepts, things that seem obvious in retrospect but which no human figured out just because of the accidents of what people happened to focus on, and (2) proving things that require long, tedious, intellectually unsatisfying calculations, which would cause a human mathematician to give up for boredom.

Re: Mathematicians issue warning as AI rapidly gains ground

#110

Earlier quoted context omitted.

Like other commenters, I think you’re also underestimating the complexity of esoteric higher level math. Consider the “Magnus Carlsen” of mathematics, who is more capable of understanding mathematics than any other human. But then also realize that that individual has probably devoted their entire career into a specific subdomain of mathematics. Within other deep recesses of mathematics, this Magnus equivalent will b…

I don't get it. LLMs don't have ego, they don't have the ability to say "no, this should be obvious, I'm not going to explain further", they are just token predictors, and given context, they can generate more tokens. If you don't understand how the answer was derived? You just ask more questions and it isn't going to get bored or annoyed, it will just try to answer the questions. Is that what is offending you so muc…

Excluding supergeniuses, pure mathematics—even at a very basic, undergraduate level—simply can't be understood passively. Even with an infinitely patient AI teacher who could answer any question on-demand, it'd still require a massive amount of work to actually understand anything in research-level mathematics. Basically every single word in a mathematical definition is a term of art, and (IME) if one doesn't grok each of those words at a fairly deep level, the new definition never really makes too much sense. And this applies recursively: each of the words has some thoroughly inscrutable definition of their own.

Of course it'd be super helpful to have, say, a teacher who could tailor explanations to anyone's precise background (e.g. where possible, using examples that come from the student's field of study when explaining some abstract concept). Or, if some definition comes with some precondition that has no obvious purpose, perhaps an omniscient teacher could explain why it's there with concrete counterexamples.[0] But even granting all this, I think that mathematical intuition is necessarily based on a lot of hard work actually exploring definitions on one's own, with pencil-and-paper and a lot of thought. That is to say, even though the process could probably be sped up a lot with a nigh-omniscient teacher[1], I doubt that a student wouldn't still need years of training to even have a clue what's going on.

(I'm saying all this, by the way, as someone who is terrible at all this and has very little mathematical maturity[2]—I'm speaking from my own frustrating experience....)

[0] c.f. Lakatos' excellent book Proofs and Refutations

[1] without the "curse of knowledge," or else we're back to square one of "answers that are correct but useless"

[2] e.g. the "post-rigorous stage" described in https://terrytao.wordpress.com/career-advice/theres-more-to-...

Post reply on HN