How difficult would it be for Altman and these guys to start OpenAI² tomorrow and become competitive with their old company? Presumably it would require enormous startup capital?
Three senior researchers have resigned from OpenAI
421–430 of 711 posts
Re: Three senior researchers have resigned from OpenAI
#422How difficult would it be for Altman and these guys to start OpenAI² tomorrow and become competitive with their old company? Presumably it would require enormous startup capital?
Re: Three senior researchers have resigned from OpenAI
#423Earlier quoted context omitted.
I am either skeptical or envious of such claims. Someone coding so much would quickly be launched into meetings to communicate one's results and to coordinate with others. It would be my life's dream to spend 80 hours per week coding without having to communicate with others... but no one is an island...
OpenAI is an absolute unicorn, and not in the bullshit-1-mrd-vc-money-dollar sense but in being truly outstanding. Since all they do is software, that is solely because of the people involved, being able to do things and doing things that other people won't and achieving things that other people don't. When it comes to sports it's fairly obvious what outliers look like and well accepted that they exist. I don't see a…
For a certain definition of "software": when only doing one training run costs an 8 digits sum (requiring hardware one order of magnitude more expensive than that to run) I kinda dispute the "all they do is software".
It's definitely not "all software": a big part of their advantage compared to actually free and open models is the insane hardware they have access to.
The free and open LLMs are doing very well compared to OpenAI once you take into account that the cost to train them is 1/100th to 1/1000th what it costs to train the OpenAI models.
This can be seen with StableDiffusion: once the money is poured in training the models and then the model made free, suddenly the edge of proprietary solutions is tiny (if it even exists at all).
I'd like to see the actually open and free models trained on the hardware used to train OpenAI: then we'd see how much of a "software edge" OpenAI has.
And my guess is it'd be way less impressive than you make it out to be.
Re: Three senior researchers have resigned from OpenAI
#424GPT5 pre-training just ended I believe. Brock, Pachocki, Szymon Sidor, would have likely all been involved. These are huge losses. Pachocki led pre-training for GPT-4, and probably GPT-5. Brockman is the major engineer responsible for the efficiency improvements that enabled ChatGPT and GPT-4 to be even remotely cost-effective. That is a piece that is often overlooked, but OpenAI's advantage over the competition in c…
"Greg Brockman works 60 to 100 hours per week, and spends around 80% of the time coding. Former colleagues have described him as the hardest-working person at OpenAI." https://time.com/collection/time100-ai/6309033/greg-brockman...
Re: Three senior researchers have resigned from OpenAI
#425Earlier quoted context omitted.
> and now they managed to shake up their user's trust in leadership stability Do users care about that? I care about features stability and avoidance of shitification. That's why I am usually preferring open models to depending on OpenAI's API. This drama has me curious about the outcome and if it leads to more openness from OpenAI, it may gain me back as a user.
> Do users care about that? I care about features stability and avoidance of shitification. Maybe not the individual users, but the enterprises/startups which builds around OpenAI.
Re: Three senior researchers have resigned from OpenAI
#426Re: Three senior researchers have resigned from OpenAI
#427Earlier quoted context omitted.
Hi, can we talk about the elephant in the room? I see breathless talk about "AGI" here, as if it's just sitting in Altman's basement and waiting to be unleashed. We barely understand how consciousness works, we should stop talking about "AGI". It is just empty, ridiculous techno-babble. Sorry for the harsh language, there's no nice way to drive home this point.
Why not? It's on topic. Should people discussing nuclear energy not talk about fusion?
Also, I hope my response to tempestn clarifies a bit more.
Edit: I'll be more explicit by what I mean by "nuance" — see Stuart Russell. Check out his book, "Human Compatible". It's written with cutting clarity, restraint, thoughtfulness, simplicity (not to be confused with "easy"!), an absolute delight to read. It's excellent science writing, and a model for anyone thinking of writing a book in this space. (See also Russell's principles for "provably beneficial AI".)
Re: Three senior researchers have resigned from OpenAI
#428GPT5 pre-training just ended I believe. Brock, Pachocki, Szymon Sidor, would have likely all been involved. These are huge losses. Pachocki led pre-training for GPT-4, and probably GPT-5. Brockman is the major engineer responsible for the efficiency improvements that enabled ChatGPT and GPT-4 to be even remotely cost-effective. That is a piece that is often overlooked, but OpenAI's advantage over the competition in c…
"Greg Brockman works 60 to 100 hours per week, and spends around 80% of the time coding. Former colleagues have described him as the hardest-working person at OpenAI." https://time.com/collection/time100-ai/6309033/greg-brockman...
I understand that sometimes is worth it, to create a great product, solve something important or just for fun. But beware
Re: Three senior researchers have resigned from OpenAI
#429So what was he lying about that got the board so pissed? A story that fits is that they assumed/knew that he had different goals and/or was going to create a spinoff. If they waited for the GPT5 pretraining to finish and then they minimized the cost of the loss of Altman and the engineers. The whole secrecy, compartmentalization and urgency of their actions could only be explained by being against a wall. Otherwise i…
Board had to act fast to fix it. And OpenAI changed enterprise pricing of API to be up front for cashflow related to that.
Re: Three senior researchers have resigned from OpenAI
#430GPT5 pre-training just ended I believe. Brock, Pachocki, Szymon Sidor, would have likely all been involved. These are huge losses. Pachocki led pre-training for GPT-4, and probably GPT-5. Brockman is the major engineer responsible for the efficiency improvements that enabled ChatGPT and GPT-4 to be even remotely cost-effective. That is a piece that is often overlooked, but OpenAI's advantage over the competition in c…
"Greg Brockman works 60 to 100 hours per week, and spends around 80% of the time coding. Former colleagues have described him as the hardest-working person at OpenAI." https://time.com/collection/time100-ai/6309033/greg-brockman...