[dupe]
More discussion: https://news.ycombinator.com/item?id=40390831
"I lost trust": Why the OpenAI team in charge of safeguarding humanity imploded
11–14 of 14 posts
Re: "I lost trust": Why the OpenAI team in charge of safeguarding humanity imploded
#12Are they sure quitting is the best thing they can do? Is the team that's supposed to be in charge of AI safety really unable to do anything about AI safety? Why give up your seat at the table? Could be there's a lot these ex employees are not sharing...
The screenshot of the tweet thread at the end seemed to indicate that the alignment team wanted to explore other avenues(or models) to get to AGI, while the company leadership wanted to keep improving on the transformer models.
From the business point of view, continuing to improve the goose that is laying the golden eggs makes sense, but as a researcher they might have already ended up seeing the limit of adding compute and data, and wanted to pivot. As someone who worked a mid level manager/engineer, I can understand the frustration involved in making the management level understand what's really happening on the ground level.
Re: "I lost trust": Why the OpenAI team in charge of safeguarding humanity imploded
#13Earlier quoted context omitted.
Here is the primary source: https://news.ycombinator.com/item?id=40391412
Thanks, have seen this - however, it seems like this article is jumping to conclusions about what this means. Could it be that executives at OpenAI are scared of what they built, or could another interpretation be that the senior leadership doesn't see what they are building as an actual threat because it isn't? (I personally do not believe that we will accomplish anything close to AGI with our current strategies, an…
> Thanks, have seen this - however, it seems like this article is jumping to conclusions about what this means. Could it be that executives at OpenAI are scared of what they built, or could another interpretation be that the senior leadership doesn't see what they are building as an actual threat because it isn't?
The article left the pretty strong impression OpenAI's leaders, especially Altman, are too busy trying to make money and amass power now to care about any long term risk, and that's reflected in their actions.
Re: "I lost trust": Why the OpenAI team in charge of safeguarding humanity imploded
#14My bet would be they saw the kind of ideas people brought in return for funding and how they would do almost everything to become the next Google. Imagine social score and surveillance based on multi-modal LLM combined with military target selection and running politics via "AI". I'd quit too if I had to be complicit in that stuff. There's only so much ethical sabotage you can do.
Combined with the reports of AI being used in Gaza :)))