Live data from Hacker News

OpenAI’s head of ethics leaves less than a year after joining

ft.com

161–170 of 505 posts

Re: OpenAI’s head of ethics leaves less than a year after joining

#161

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

Maybe in this case all they needed an ethics team for was to teach the LLM about ethics?

Re: OpenAI’s head of ethics leaves less than a year after joining

#162

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

If you ever feel like your job is useless, remember that raytheon has an ethics team.

It's RTX now and some of the reverse engineering/vulnerability researcher folks that work/worked there are some of the best people I've met across the entire security industry...

Re: OpenAI’s head of ethics leaves less than a year after joining

#163
A poli-sci major...who was an "ethicist" at Meta...

I'm having a hard time deciding what part of this is the most ridiculous. Contenders include:

- A political Science major lecturing on ethics.

- Meta and ethics in the same paragraph.

- A company who's CEO has credibly threatened (publicly) the livlihoods of hundreds of millions of people globally so much as paying lip service to ethics as a concept.

- Any news outlet feigning credulity hard enough to deadpan reporting on any of this.

Is it possible to roll one's eyes hard enough to injure oneself?

Re: OpenAI’s head of ethics leaves less than a year after joining

#164

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

> They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

> “It is difficult to get a man to understand something, when his salary depends upon his not understanding it!” - Upton Sinclair

Think I first saw that on a usenet post, as true now as then and just as true as it was in the 1930's when he wrote it (in at least that form).

Re: OpenAI’s head of ethics leaves less than a year after joining

#165
post #121

Earlier quoted context omitted.

OpenAI was probably able to at least pretend that her role mattered... until they let their AI autonomously hack a rival company, then used the incident to score marketing points. I'm not surprised she left.

[flagged]

Then do it. Tell us. Spill the tea and provide your evidence, don't just vaguely gesture at something behind the curtains like you're discount Morpheus.

Re: OpenAI’s head of ethics leaves less than a year after joining

#167

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

If you ever feel like your job is useless, remember that raytheon has an ethics team.

Isn't that a good thing? You would prefer they didn't?

Re: OpenAI’s head of ethics leaves less than a year after joining

#168
post #93

The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt. I want to clarify that I am not doubting…

Cynic in me says basically part of her implicit job description was taking fake falls when shit happens . Kind of like a CEO is paid for more than the work they do, but also the responsibility they must appear to take publicly (for big money).

Re: OpenAI’s head of ethics leaves less than a year after joining

#169

Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…

There's no way to make an EAOS score automatically. If we had that, that's the whole fix. Just reject answers with low ethics numbers.

Re: OpenAI’s head of ethics leaves less than a year after joining

#170

Earlier quoted context omitted.

Whats the definition of EAOS though who's ethics? Greek-Roman, Western, Islamic, Buddhist, Hinduism, Human rights (western values)..

There is a presumption here that there aren’t ethical “rules” shared by all of these systems to create a baseline that is generally shared across humanity.

The devil is in the details.
Post reply on HN