Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI’s head of ethics leaves less than a year after joining

ft.com

Post reply on HN
Print view View original

81–90 of 368 posts

Re: OpenAI’s head of ethics leaves less than a year after joining

#81

Post by antonvs »

summarybot wrote: post #68

Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…

What happens if we do the same for CEOs?

Re: OpenAI’s head of ethics leaves less than a year after joining

#82

Post by forestrywat »

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

Re: OpenAI’s head of ethics leaves less than a year after joining

#83

Post by jerf »

antonvs wrote: post #81
summarybot wrote: post #68

Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…

What happens if we do the same for CEOs?

The same thing for both: Goodhart's Law.

Re: OpenAI’s head of ethics leaves less than a year after joining

#85

Post by fwipsy »

> In recent times, Johannes Heidecke, Head of OpenAI's Safety Systems team, also left the company – as did OpenAI’s Chief Futurist Joshua Achiam.

It's OK though, they don't need an ethics team because everyone at OpenAI is ethical:

> “AI ethics doesn’t live with one owner or team at OpenAI and ethical considerations are deeply embedded into the model-building process driven by a number of teams across research."

Re: OpenAI’s head of ethics leaves less than a year after joining

#87

Post by dgellow »

onion2k wrote: post #48
Avicebron wrote: post #21

Earlier quoted context omitted.

Rubber stamp for hire?

I'd accept a few hundred grand to reply to emails with "No, the torment nexus is a net benefit.."

They finally found a way to automate that role with GPT!

Re: OpenAI’s head of ethics leaves less than a year after joining

#89

Post by nilamo »

kelseyfrog wrote: post #72
nilamo wrote: post #71

Earlier quoted context omitted.

Just because the ethicist says something is a bad idea, doesn't mean anyone else is obligated to make a change. ie: blaming her for anything instead of the decision makers is... really weird?

No influence, same toil? One must imagine her happy.

Why must I imagine that? We're assuming it's a position where you're screaming pointlessly into the void, and never accomplish anything. That sounds miserable, I'd leave, too.
Post reply on HN