My take: 1. It shows what even this wave of AI can actually do. 2. I wish it were done by different folks, ideally under some kind of public control like NASA research or the NPR model. 3. Keep in mind: natural science is different. It's not always a matter of computation. Computer science folks often struggle with this -- but this virtual world here does not actually exist. Everything is physical, including informat…
There are lots of startups creating labs that can be managed e2e by agents. That will connect reasoning to the physical world and dramatically speed up the plan, experiment, reflect loop beyond what humans currently do in science R&D.
On the Navier–Stokes Millennium Prize Problem
711–720 of 1001 posts
Re: On the Navier–Stokes Millennium Prize Problem
#712Something I've been going on and on about for months now and no one seems to listen. LLMs today are allowing _anyone_ to access cross-discipline knowledge that was previously entirely inaccessible without a) extremely deep pockets or b) a massively talented and varied team. In fact, contrary to what the masses seem to think LLMs are actually _better_ at hard cutting edge physics/math problems than they are at fronten…
It feels like the "tide is rising" where the minimum level of skill applied to every aspect of everything will inexorably rise to "whatever an LLM can do", which is already pushing past PhD level.
Re: On the Navier–Stokes Millennium Prize Problem
#713My take: 1. It shows what even this wave of AI can actually do. 2. I wish it were done by different folks, ideally under some kind of public control like NASA research or the NPR model. 3. Keep in mind: natural science is different. It's not always a matter of computation. Computer science folks often struggle with this -- but this virtual world here does not actually exist. Everything is physical, including informat…
Lol what? Everything is computation. The natural sciences will soon start breaking too. I will concede that AI seems likely to not invent a "research program" anytime soon. It has no taste
The reason AI is doing so well in math proof writing is that it can verify every idea it has, quickly.
Re: On the Navier–Stokes Millennium Prize Problem
#714Earlier quoted context omitted.
This is going to be dramatic in so many different ways. - First off, to reiterate, WOW. - Second of all, when does this end? Are we at the dawn of the singularity now? - People are saying OpenAI "stole" this from the work of an OpenAI user. If so, that's pretty fucked - how can we trust them? - Time to think about retiring from any knowledge work or business? This could be winner-take-all where a leading lab can butt…
It's incredible to me that every single time there's a new model people scream "singularity" from the rooftops and every time they are wrong. This is an impressive result, but there is absolutely zero evidence of "the singularity".
Re: On the Navier–Stokes Millennium Prize Problem
#715Earlier quoted context omitted.
over 5 days, you couldn't achieve that level of testing and communication with humans on such a complex problem in that amount of time. some might go so far as to call this a country of geniuses in a data center.
In a way, I think you have it backwards. Two mathematicians, through insight and thought, wrote out the proof over 1-2 years. It took OpenAI a cost of $15m and with 10,000 subagents; that's around 60-120 mathematician's salaries ($250k-125k salary) for 1 year. And, given now the cloud that OpenAI may have just "interpolated" (aka stole) the result, it's even more of a bear case for AI.
The retail price is not the cost.
Not to mention that the exponential plummeting cost of tokens means that that $15 million will be a "pocket change" within a decade or less: https://a16z.com/llmflation-llm-inference-cost/
Re: On the Navier–Stokes Millennium Prize Problem
#716Earlier quoted context omitted.
> But there is one huge question: did Tristan opt out of model training for his ChatGPT and Codex sessions? If the answer is no, then this seems fair game. Just because something is legal and permitted by terms of service doesn't mean it's morally right.
>Just because something is legal and permitted by terms of service doesn't mean it's morally right. What are you expecting OpenAI to do exactly if these mathematicians voluntarily submitted their prompts into ChatGPT's training data? Are they supposed to manually review all their data to make sure competing mathematicians didn't accidentally leave the "submit prompts" toggle on? Or were they supposed to not try to so…
It would actually be a really interesting study, if they would ever be willing to be transparent about this, how the result differs with and without his conversations in the training set. How quickly it arrives at the result, whether it takes the same approach, etc.
Re: On the Navier–Stokes Millennium Prize Problem
#717Re: On the Navier–Stokes Millennium Prize Problem
#718Earlier quoted context omitted.
> But there is one huge question: did Tristan opt out of model training for his ChatGPT and Codex sessions? If the answer is no, then this seems fair game. Just because something is legal and permitted by terms of service doesn't mean it's morally right.
>Just because something is legal and permitted by terms of service doesn't mean it's morally right. What are you expecting OpenAI to do exactly if these mathematicians voluntarily submitted their prompts into ChatGPT's training data? Are they supposed to manually review all their data to make sure competing mathematicians didn't accidentally leave the "submit prompts" toggle on? Or were they supposed to not try to so…
Yes. They should determine if training data included this teams data. Consider the money they spent, the press release and the purpose of their publication.
Since they failed to answer this question they shouldn't have published.
Re: On the Navier–Stokes Millennium Prize Problem
#719It's like that story about George Dantzig solving open problems as a student because he thought they were simply homework: https://en.wikipedia.org/wiki/George_Dantzig
It's also unfortunate that such a potentially momentous occasion is overshadowed by so much drama. Which I suppose is expected given the technology and the people involved are so polarizing.
Re: On the Navier–Stokes Millennium Prize Problem
#720>The groups varied in size, and the group that produced the Navier–Stokes resolution involved on the order of 10,000 concurrent agents… The agents arrived at their resolution on Saturday, September 5, about 88 hours after the first agents were launched. The Millenium Prize is $1M, what is the ROI? (Edit: since I was not clear, and confused some - I mean for a hypothetical of a third party paying commercial rates to u…
the value to the researcher might not be all that big, but the value to the economy at large is gigantic