Earlier quoted context omitted.
It's specifically the last two bullet poitns - Tristan is suspicious of the timing, as only few others were trying this approach. OpenAI says the model didn't access his user data directly, but leaves unanswered whether Tristan's chat conversations were part of the training. - OpenAI says they would partially credit Tristan for the $1,000,000 discovery (even though Tristan did not solve the $1,000,000 problem) — but…
Both Sam Altman and Sebastien Bubeck admitted they only want Buckmaster to be the lead author on a rewrite of the OpenAI proof. https://x.com/sama/status/2097385167002415140 https://x.com/SebastienBubeck/status/2097379411691516310 A wake up call for using OpenAI models. If you discover something with their model and you work for a competitor, they “felt it would be inappropriate” for you “to author OpenAI’s work”.
Navier-Stokes – Tristan Buckmaster [pdf]
651–660 of 869 posts
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#652Earlier quoted context omitted.
It's specifically the last two bullet poitns - Tristan is suspicious of the timing, as only few others were trying this approach. OpenAI says the model didn't access his user data directly, but leaves unanswered whether Tristan's chat conversations were part of the training. - OpenAI says they would partially credit Tristan for the $1,000,000 discovery (even though Tristan did not solve the $1,000,000 problem) — but…
Both Sam Altman and Sebastien Bubeck admitted they only want Buckmaster to be the lead author on a rewrite of the OpenAI proof. https://x.com/sama/status/2097385167002415140 https://x.com/SebastienBubeck/status/2097379411691516310 A wake up call for using OpenAI models. If you discover something with their model and you work for a competitor, they “felt it would be inappropriate” for you “to author OpenAI’s work”.
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#653Earlier quoted context omitted.
Both Sam Altman and Sebastien Bubeck admitted they only want Buckmaster to be the lead author on a rewrite of the OpenAI proof. https://x.com/sama/status/2097385167002415140 https://x.com/SebastienBubeck/status/2097379411691516310 A wake up call for using OpenAI models. If you discover something with their model and you work for a competitor, they “felt it would be inappropriate” for you “to author OpenAI’s work”.
A mathematician working for the competitor, solving a math problem using our model? Isn’t that the best marketing possible?
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#654OpenAI's release explicitly says No. But then also caveats that with "we cannot rule out that de-identified data derived from their usage of our products" impacted things. What's most striking to me, and what may or may not be true, is the "we cannot rule out" bit. "We (the researchers and the agents) did not see any of their work through any means until they released it publicly — in particular, no specific user dat…
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#655Earlier quoted context omitted.
Both Sam Altman and Sebastien Bubeck admitted they only want Buckmaster to be the lead author on a rewrite of the OpenAI proof. https://x.com/sama/status/2097385167002415140 https://x.com/SebastienBubeck/status/2097379411691516310 A wake up call for using OpenAI models. If you discover something with their model and you work for a competitor, they “felt it would be inappropriate” for you “to author OpenAI’s work”.
A mathematician working for the competitor, solving a math problem using our model? Isn’t that the best marketing possible?
Sam+Seb are struggling with their ideological allegiance. This amounts to a confession that there are no reseaechers, only research managers, left at OpenAI. Maybe they even know that they are losing credibility from their main investor(s). They desperately need a domain expert to salvage credibility.
They have no credibility with academia left, obviously, but their main competitor still does. No Millennium prize incoming, I'd wager. For openAI. Let's see mAth get political for once!!
One might be more certain that levent is now going to corner all the institutional support. Go go go!
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#656From OpenAI: > While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models This is the crux of it. If Tristan's work and insights were not used to train OpenAI models, then this just looks like a case of hyper-competitive academic sniping that has been going on for decades (check out Watson and Crick!) accelerated by AI as a tool. The fact that this is…
That's assuming they actually honor this which I'm highly sceptical of. Especially for internal frontier models
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#657Is this the future we're headed towards? Where I'll be afraid to use google docs in case Google identifies value in whatever I'm writing about and snipes it if it my docs make it into the next round of model training?
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#658The timeframes don't really fit for Codex logs to be used in training/fine-tuning, do they? This wouldn't be a few-day endeavour? Direct access to Codex history for sure I'd believe, but another (the most?) likely scenario to me feels like OpenAI got wind of these guys' progress, then used their massive infrastructure advantage to throw compute at the problem ahead of them and front-run them. Still has a really bad s…
They probably just had an employee read his chats, figure out the general approach, and feed it to Codex. All they said was the model doesn’t look up user data, not employees.
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#659Thats how most people use LLMs? If I was back in my student days working in Navier-Stokes, I guess I would also punch at blow ups. The number of students doing this at the same time, posting open efforts to GitHub then retraining of the models. If there is solutions to the problem, it’s a real possibility that it was not a result of this effort?
Using a large amount of tokens is not a good augment that it’s not likely others have done the same. Good questions is the difference between $10 and $10M in token usage to solve a problem.
Re: Navier-Stokes – Tristan Buckmaster [pdf]
#660Earlier quoted context omitted.
I think this might be a red herring. All it takes is someone to get an inkling that someone is working on a new approach and seeing some success for OpenAI to fire the AI cannon at the problem. The community seems fairly small (from this outsider's point of view). The idea that the data made it into the training set and that's how the bot figured it out is definitely possible, but I would want to rule out the simpler…
Terence Tao said the same[1] > In fact, it is now the identification of a promising problem which is the scarce and precious resource. We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential. The incentives may now be pointing in the direction of no longer sharing any…