A misalignment of AI in mathematics

You mean manufacturing

The average programmer is outraged by OpenAI's methods, too.

I don't care how good Astra or any subsequent models they may release might be... I am never going back to those token reset shenanigans.

The point is human understanding. If the LLMs understand, but the humans don’t, where does that leave humanity? Building things we don’t understand is a sure path to facing consequences we can’t predict.

Your comment also conveniently ignores the plagiarism aspect of it all. Who is coping here?

Open source developers have been used by corporations who took their code and created closed SaaS companies.

Now it is the turn of mathematicians who voluntarily contribute ideas, strategies and almost finished proofs in their writings and prompts to closed PaaS (Plagiarism as a Service) companies.

OSS developers have never been respected by the parasites, neither will mathematicians. Your Fields Medals do not protect you from tech bro narcissists. You are a human resource.

To me it doesn't seem like what AI has destroyed is the ability for mathematicians to develop understanding and share it with each other, but rather it's destroyed the yardstick (solving open problems) that has traditionally been used to measure how much they have contributed to that understanding.

I do see how this is a problem in terms of assigning credit, but I think the cat is already out of the bag in terms of these models being capable. Even without AI labs spending millions of dollars to solve millennium prize problems, there are plenty of other people who will use them to pick low hanging fruit. I don't think any social solution is going to make things go back to the way they were, where you could share your progress towards a famous open problem without risking someone "scooping" you within a couple of days.

I think that the most likely outcomes are either mathematics becomes more secretive, or there is a more deliberative approach to assigning credit than who was "first" to solve some problem. In the former case, this may slow down progress, and in the latter case, this could mean that credit would become more subjective, and be a continual source of controversy.