Live data from Hacker News

OpenAI’s head of ethics leaves less than a year after joining

ft.com

131–140 of 499 posts

Re: OpenAI’s head of ethics leaves less than a year after joining

#131

Earlier quoted context omitted.

Until you accept that they didn't 'easily become homeless' the problem will continue. They used drugs and spiraled, usually over the course of many months or years, forced all their friends to turn their backs on them, got kicked out of any living situations they had access to because of drug/alcohol use or theft to support the same and finally ended up on the street. On the street they have access to almost endless…

Perhaps you aren't aware, but only about a third of homeless people are drug addicts, from the surveys I've seen.

[dead]

Re: OpenAI’s head of ethics leaves less than a year after joining

#132
post #97
post #93

The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt. I want to clarify that I am not doubting…

It's unlikely HugginFace colluded given they specifically cited they used open models to save them from the hacking.

HuggingFace's use of models in this incident keeps getting characterized this way but it's not true that HG used GLM-5.2 to "save them" from OAI's attack. OAI's model had already hacked and compromised HG by the time they became aware of it. GLM-5.2 was used in the post-mortem phase uncovering everything that was done. It wasn't two models battling each other live. (though that future may be coming soon)

Re: OpenAI’s head of ethics leaves less than a year after joining

#133

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

Scapegoat team (when working for an obviously unethical company).

I have no knowledge of this particular person, but usually the job of an ‘ethicist’ is to find excuses for something obviously wrong.

Re: OpenAI’s head of ethics leaves less than a year after joining

#135
post #121

Earlier quoted context omitted.

[flagged]

What if you actually told us, instead of just asking a question? If you have something to say, say it. Don't vaguepost.

“When you have to shoot, shoot; don’t talk.” — Ugly

Re: OpenAI’s head of ethics leaves less than a year after joining

#136

Earlier quoted context omitted.

If you ever feel like your job is useless, remember that raytheon has an ethics team.

Wouldn't that be probably one of the most important places to have an ethics team? I'd be much more worried if my local water treatment plant or local bar had an ethics team, and people working there probably would feel slightly more useless than Raytheon's ethics team, which I'm sure feel like they're doing something important and worthwhile.

Come on, what do you think the ethics team at Raytheon is going to say "Hmm, our elected leaders are relying heavily on dangerously inaccurate AI to choose bombing targets and our weapons hit a girl's school as a result, let's withhold weapons from our own govt till that's resolved"?

Obviously not. The ethics team at Raytheon is not going to ever be allowed to overrule the leadership or more importantly the political leadership of this country whose support of Raytheon is fundamental to their survival

Re: OpenAI’s head of ethics leaves less than a year after joining

#137

[flagged]

How do I get on this gravy train

You need to actually do some NGO / oversight / ethics work that matters for a while, then you're the perfect candidate for these kinds of roles where you'll be able to do a lot but ultimately not be able to change anyone's already made up opinions within the company. These big companies have other roles than just head of ethics, even sometimes Civil Rights officers, etc. They make a lot but don't get to do anything and a lot of times they just use these jobs to make some money then jump back to non-profits, etc.

Re: OpenAI’s head of ethics leaves less than a year after joining

#138

Earlier quoted context omitted.

Wouldn't that be probably one of the most important places to have an ethics team? I'd be much more worried if my local water treatment plant or local bar had an ethics team, and people working there probably would feel slightly more useless than Raytheon's ethics team, which I'm sure feel like they're doing something important and worthwhile.

Come on, what do you think the ethics team at Raytheon is going to say "Hmm, our elected leaders are relying heavily on dangerously inaccurate AI to choose bombing targets and our weapons hit a girl's school as a result, let's withhold weapons from our own govt till that's resolved"? Obviously not. The ethics team at Raytheon is not going to ever be allowed to overrule the leadership or more importantly the political…

I have literally no clue, hence I won't try to claim I know exactly what's going on there. For all we know, the ethics team at Raytheon could have stopped multiple international nuclear wars already.

Re: OpenAI’s head of ethics leaves less than a year after joining

#139
post #97
post #93

The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt. I want to clarify that I am not doubting…

It's unlikely HugginFace colluded given they specifically cited they used open models to save them from the hacking.

As I recall they actually used closed models, were rejected by cybersecurity guardrails, and then used open models
Post reply on HN