Earlier quoted context omitted.
If it really was about “safety” then why wouldn’t Ilya have made some statement about opening the details of their model at least to some independent researchers under some tight controls. This is what makes it look like a simple power grab, the board has said absolutely nothing about what actions they would take to move toward a safer model of development.
Because they want to slow down further research which would push AGI closer until the safety/alignment aspect can catch up.
Emmett Shear becomes interim OpenAI CEO as Altman talks break down
681–690 of 979 posts
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#682Earlier quoted context omitted.
Oh hey there he is, cool. I had a typo in my search, I think. > That's not what a religious text is, that'd just be a blog post. Yes, almost as if "Lesswrong is a community blog dedicated to refining the art of human rationality." > It's the part where reading it causes you to join a cult group house polycule and donate all your money to stopping computers from becoming alive. I don't think anybody either asked someb…
“The Sequences”? Yes, this doesn’t sound like a quasi-religious cult at all…
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#683Earlier quoted context omitted.
The information is a 300 dollar annual subscription, I don’t think they will allow it
Oh wow, that's like the most I've seen for any news subscription.
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#684The contrast between the media's depiction of today's events with this outcome demonstrates how much Sam and his aligned interests can influence a narrative. The vast majority of reporting indicated that Sam held all the leverage, the board members were about to be fired, and a new board would be appointed which would be much better aligned with Sam. These accounts took special care to portray the current board as in…
There is one thing that sticks out: Why didn't the board explain itself clearly? There are times when saying anything publicly would be considered defamation and openining themselves to lawsuits, but it seems that they owe it to their own staff in plain words. They didn't explain the situation properly as per leaked internal announcements.
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#685Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#686Through all of this, no one has cogently explained why Altman leaving is such a big deal. Why would workers immediately quit their job when he has no other company, and does he even know who these workers are? Are these people that desperate to make a buck (or the prospect of big bucks)? It seems like half of the people working at the non-profit were not actually concerned about the mission but rather just waiting ou…
> Why would workers immediately quit their job when he has no other company It is Sam Altman. He will have one in a week. > It seems like half of the people working at the non-profit were not actually concerned about the mission but rather just waiting out their turn for big bucks and fame. I would imagine most employees at any organization are not really there because of corporate values, but their own interests. >…
Welcome to Cargo Cult AI.
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#687Through all of this, no one has cogently explained why Altman leaving is such a big deal. Why would workers immediately quit their job when he has no other company, and does he even know who these workers are? Are these people that desperate to make a buck (or the prospect of big bucks)? It seems like half of the people working at the non-profit were not actually concerned about the mission but rather just waiting ou…
The board fired Altman for shipping too fast compared to their safety-ist doom preferences. The new interim CEO has said that he wants to slow AI development down 80-90%. Why on earth would you stay, if you joined to build + ship technology? Of course, some employees may agree with the doom/safety board ideology, and will no doubt stay. But I highly doubt everyone will, especially the researchers who were working on…
OpenAI would not exist if FAANG had been capable of getting out of it's own way and shipping things. The moment OpenAI starts acting like the companies these people left, it's a no brainer that they'll start looking for the door.
I'm sure Ilya has 10 lifetimes more knowledge than me locked away in his mind on topics I don't even know exist... but the last 72 hours are the most brain dead actions I've ever seen out of the leadership of a company.
This isn't even cutting your own nose of to spite the face: this is like slashing your own tires to avoid going in the wrong direction.
The only possible justification would have been some jailable offense from Sam Altman, and ironically their initial release almost seemed to want to hint that before they were forced to explicitly state that wasn't the case. At the point where you're forced to admit you surprise fired your CEO for relatively benign reasons how much must have gone completely sideways to land you in that position?
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#688Earlier quoted context omitted.
Because they want to slow down further research which would push AGI closer until the safety/alignment aspect can catch up.
But if you really cared about that why would you be so opaque on everything. Usually people with strong conviction try to convince other people of that conviction. For a non profit that is supposedly acting in the interests of all mankind, they aren't actually telling us shit. Transparency is pretty much the first thing everybody does who actually cares about ethics and social responsibilities.
https://x.com/esyudkowsky/status/1725630614723084627?s=46
Mr. Yudkowsky is a lot like Richard Stallman. He’s a historically vital but now-controversial figure whom a lot of AI Safety people tend to distance themselves from nowadays, because he has a tendency to exaggerate for rhetorical effect. This means that he ends up “preaching to the choir” while pushing away or offending people in the general public who might be open to learning about AI x-risk scenarios but haven’t made up their mind yet.
But we in this field owe him a huge debt. I’d sincerely like to publicly thank Mr. Yudkowsky and say that even if he has fallen out of favor for being too extreme in his views and statements, Mr. Yudkowsky was one of the 3 or 4 people most central to creating the field of AI safety, and without him, OpenAI and Anthropic would most certainly not exist.
I don’t agree with him that opacity is safer, but he’s a brilliant guy and I personally only discovered the field of AI safety through his writings, through which I read about and agreed with the many ways he had thought of by which AGI can cause extinction, and I as well as another of my college friends decided to heed his call for people to start doing something to avert potential exctintion.
He’s not always right (a more moderate and accurate figure is someone like Prof. Stuart Russell) but our whole field owes him our gratitude.
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#689This will be an interesting test to see how fast you can bootstrap GPT-4 level performance with unlimited funds and talent that already has deep knowledge of the internals. With the initial adoption of ChatGPT alongside Copilot, OpenAI's data moat of crawled data & RLHF is pretty vast. And that's not leaving the walled garden of OpenAI. You can simulate a lot of this using other off-the-shelf LLMs (see Alpaca) but no…
Many of OpenAIs most talented people left to start Anthropic. They have billions in funding and have not yet got particularly close to GPT-4. I think that illustrates it will be a be a big uphill battle for any new entrant no matter how well funded or resourced.
Re: Emmett Shear becomes interim OpenAI CEO as Altman talks break down
#690Earlier quoted context omitted.
Isn't this expected? Nearly everyone who joined post ChatGPT was primarily financially motivated. What is more interesting is how many of the core research team stays.
This is actually pretty surprising to me, since a financially motivated person would normally wait until a better deal, and just collect their paycheck in the meantime. There's also no guarantee that Altman will really start a new company, or be able to collect funding to hire everyone quickly. I wonder if these people are just very loyal to Sam.