Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
aimagazine.com
Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
1–10 of 88 posts
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#2> Before her role at OpenAI, which she started last August, she was the Chief Ethicist at Meta from November 2021 to August 2025.
Sounds like perfect credentials.
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#3Active discussion: https://news.ycombinator.com/item?id=49257160
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#4Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model does some task and has a very high STOS but very low EAOS, like modifying game code to win at a game rather than playing by the rules, it is unacceptable. Models going forward must all have an ethics evaluation in tandem with objectives evaluation, and only when the ethics value is high enough should actions be considered successes.
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#5Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…
Whats the definition of EAOS though who's ethics? Greek-Roman, Western, Islamic, Buddhist, Hinduism, Human rights (western values)..
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#6Just a guess, but probably the idea that AI and ethics don't mix might have crystallized into action?
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#7In this article: no explanation of why she left.
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#8Strategically the best ethic czar one can hire for a company is the one that doesn't believe in this fluffy, arbitrary definition of ethics.
100% of the time, ethics department attracts activists, which is 100% trouble for the company in the future.
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#9Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…
What happens if we do the same for CEOs?
Re: Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?
#10IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.