511–520 of 644 posts
Update: Looks like Barret Zoph, GPT-4's post training (co-)lead is also leaving: https://x.com/barret_zoph/status/1839095143397515452
Whoa! This definitely looks much more troubling for the company now. Can't decide it is because AGI is coming very soon OR AGI is very far away
Earlier quoted context omitted.
Yes, and transformer models can do more than text. There's almost certainly better options out there given it looks like we don't need so many examples to learn from, though I'm not at all clear if we need those better ways or if we can get by without due to the abundance of training data.
If you come up with a new system, you're going to want to integrate AI into the system, presuming AI gets a bit better. If AI can only learn after people have used the system for a year, then your system will just get ignored. After all, it lacks AI. And hence it will never get enough training data to get AI integration. Learning needs to get faster. Otherwise, we will be stuck with the tools that already exist. New…
2. You might need only several hundred of examples for fine-tuning. (OpenAI's minimum is 10 examples.)
3. I don't think research into fine-tuning efficiency have exhausted its possibilities. Fine-tuning is just not a very hot topic, given that general models work so well. In image generation where it matters they quickly got to a point where 1-2 examples are enough. So I won't be surprised if doc-to-model becomes a thing.
It is hard for me to square "This company is a few short years away from building world-changing AGI" and "I'm stepping away to do my own thing". Maybe I'm just bad at putting myself in someone else's shoes, but I feel like if I had spent years working towards a vision of AGI, and thought that success was finally just around the corner, it'd be very difficult to walk away.
Her rise didn't make sense to me. Product manager at tesla to CTO at openAI with no technical background and a deleted profile ? This is a very strange company to say the least.
If the government ever wants a third party to oversee safety of openAI wouldn't it be convenient if one of those that left the company started a company that focused on safety. Safe Superintelligence Inc. gets the bid because lobbying because whatever I don't even care what the reason is in this made up scenario in my head.
Basically what I'm saying is what if Sam is all like "hey guys, you know it's inevitable that we're going to be regulated, I'm going for profit for this company now, you guys leave and later on down the line we will meet again in an incestuous company relationship where we regulate ourselves and we all profit."
Obviously this is bad. But also obviously this is exactly exactly what has happened in the past with other industries.
Edit: The man is all about the long con anyway. - https://old.reddit.com/r/AskReddit/comments/3cs78i/whats_the...
Another edit: I'll go one further on this a lot of the people that are leaving are going to double down on saying that open AI isn't focused on safety to build up the public perception and therefore the governmental perception that regulation is needed so there's going to be a whole thing going on here. Maybe it won't just be safety and it might be other aspects also because not all the companies can be focused on safety.
If OpenAI is the foremost in solving the AGI - possibly the biggest invention of mankind - it's a little weird that everyone's dropping out. Does it not look like that no one wants to work with Sam in the long run?
But it makes perfect sense to drop out and enjoy last couple years of pre-AGI bliss. Advances in AI even without AGI will lead to unemployment, recession, collapse of our economic structure, and then our social structure. Whatever is on the other side is not pretty. If you are on the forefront, know it’s coming imminently, and made your money, it makes perfect sense to leave and enjoy money and leisures money allows…
Earlier quoted context omitted.
Whoa! This definitely looks much more troubling for the company now. Can't decide it is because AGI is coming very soon OR AGI is very far away
If they had any equity they might've vested and decided there is more to life than working there. It's hard to be very motivated to work at high pace when you can retire any moment without losing your lifestyle.
Update: Looks like Barret Zoph, GPT-4's post training (co-)lead is also leaving: https://x.com/barret_zoph/status/1839095143397515452
These messages really sound like written under threat. They have a weird authoritarian regime quality . Maybe they just had ChatGpt write it though.
I do think that whoever Bob is, they probably really are a good manager. EDIT: I guess that's Bob McGrew, head of research, who is now also leaving.
Earlier quoted context omitted.
But it makes perfect sense to drop out and enjoy last couple years of pre-AGI bliss. Advances in AI even without AGI will lead to unemployment, recession, collapse of our economic structure, and then our social structure. Whatever is on the other side is not pretty. If you are on the forefront, know it’s coming imminently, and made your money, it makes perfect sense to leave and enjoy money and leisures money allows…
I highly doubt that's the case. The US government will undoubtly seize OpenAI, the assets and employees way before it happens in the name of national security. I am pretty sure that they got a special team keeping an eye on the internal comms at openai to make sure they are on top of their internal affairs.
Earlier quoted context omitted.
Greg Brockman, OpenAI President and co-founder is also on extended leave of absence. And John Schulman, and Peter Deng are out already. Yet the company is still shipping, like no other. Recent multimodal integrations and benchmarks of o1 are outstanding.
> Yet the company is still shipping, like no other If executives / high level architects / researchers are working on this quarter's features something is very wrong. The higher you get the more ahead you need to be working, C-level departures should only have an impact about a year down the line, at a company of this size.