Earlier quoted context omitted.
The statement is not about AI but about the behaviour of AI companies. OpenAI have put vast resource into solving open maths problems: many millions of dollars of compute just on the Navier-Stokes result, plus whatever they spent on the broader Millenium Prize problems initiative and the other results they have published. Anthropic are doing the same. The statement is asking them to stop doing this. AI companies are…
What do we do about the problems that don't require many millions of dollars in resources? Last weekend I spun up a small agent swarm and pointed it at a field of math I have some affinity towards. Within four hours I had settled three conjectures, one of which is rather famous (for the field, not in general). It cost me about four hundred dollars. I am at a loss about what to do with these results. On one hand I fee…
A misalignment of AI in mathematics
941–950 of 956 posts
Re: A misalignment of AI in mathematics
#942Re: A misalignment of AI in mathematics
#943As a mathematician maybe I am a little more optimistic than this declaration. I am thinking of Mochizuki's abc conjecture: He worked in relative isolation, and dumped a huge incomprehensible proof on the community (to oversimplify a bit). That's not totally unlike what might happen if AI generates a huge, incomprehensible proof of let's say RH. Well, what is the result? In the Mochizuki case, it was a lot of skeptici…
Re: A misalignment of AI in mathematics
#944Re: A misalignment of AI in mathematics
#945Earlier quoted context omitted.
This really resonates with me. I'm early in my PhD and I'm researching a niche form of data compression and IC design. I don't use any AI at all in my research, I do it the super old fashioned way, I read papers cover to cover and sections of textbooks to familiarise myself with the field. I genuinely enjoy doing this, it's really fun to think critically about what an author wrote or how a particular approach works.…
I’m no big AI cheerleader, but why don’t you try these models to see what they offer - they might suggest some things you haven’t thought of, or save you some time in your research. Are you sure they’d one-shot your algorithm? Maybe they’d come up with worse, maybe better, but you are in a perfect position to actually judge the validity of any claims a LLM makes in this realm, which most people are not. As to why bot…
One reason not to try is to create an air gap between the OP's ideas and the data that future models can train on. We saw that the mathematicians who trusted OpenAI and Anthropic with their preliminary work found the rug pulled out of their feet by those same companies.
Another reason is to avoid inadvertently plagiarising the work of other mathematicians. Any mathematical insight that comes out of an LLM is the result of training on the entire bibliography of mathematical research, but those insights are spat out of the models without attribution. If you use AI in your matematical research you are only using the work of others without even knowing who they are and what they contributed.
And yet another reason is to avoid polluting your mind with the ideas that come out of the AI. Maybe you get a hint that pushes you to one direction, when you would go into an entirely other direction without that hint. And then maybe that becomes a habit and you can't find new directions without asking the all-knowing oracle.
tl;dr: opsec, integrity and independence are the reasons to not use LLMs in your research. I don't.
Re: A misalignment of AI in mathematics
#946Earlier quoted context omitted.
You are assuming that people remain in control.
And you are assuming they don't remain in control. Which of you is right? We don't know yet, but I don't find the arguments of card-carrying doomers any more convincing that those of card-carrying singularitarian utopians. Historically though, technological improvement has lead to large increases of living standards for the overwhelming majority of people, so I think that past trends support the utopian view more tha…
I am not assuming humans don't remain in control, but rather, I am not axiomatically assuming there's any inherent reason we will.
Re: A misalignment of AI in mathematics
#947Earlier quoted context omitted.
We can't be sure AI will be able to ask the questions of the future. At least right now, AI is not capable of that.
Why do you need AI to ask the questions? You give your AI the problem, like 'make this computer program faster and more reliable', and it'll go off and do the math necessary to make it so.
Re: A misalignment of AI in mathematics
#948This sounds a lot to me like people in the 90's complaining that computers were destroying chess. Thirty years later, chess is more popular than it ever was, and chess players are better than they ever have been. I wouldn't be surprised if there are now more chess books now than there ever have been. Furthermore, it turns out that a lot of chess books written before computers were just wrong about a lot of things. It…
Re: A misalignment of AI in mathematics
#949Earlier quoted context omitted.
I mean, was the point of math ever just because some humans enjoyed doing it? Even though a lot of it is theoretical, there's been all sorts of useful things that have come out of it as well due to an improved understanding of the universe through new ways of thinking about it. If it got to the point where no human could understand it and there were no ways to actually use it, I don't think anyone would bother having…
> was the point of math ever just because some humans enjoyed doing it? Yes. Friends and I often work on Putnam problems and this series: The (Almost) Impossible Integrals, Sums, and Series by Cornel Ioan Vălean
Re: A misalignment of AI in mathematics
#950Earlier quoted context omitted.
They said "We're looking at a future". And if that future ends up developing the way these companies want it to then we're looking at extremely dystopian future where AI is essential to all work and people have to buy their "intelligence" from an oligopoly of large providers who have total control over the price and capabilities whilst simultaneously having unfiltered read/write access to people's stream-of-conscious…
Open AI models are just a few months behind closed models, and the gap is actually getting more narrow.