Live data from Hacker News

OpenAI’s head of ethics leaves less than a year after joining

ft.com

91–100 of 282 posts

Re: OpenAI’s head of ethics leaves less than a year after joining

#91
post #37

Earlier quoted context omitted.

> High rents are created by high local productivity. Wrong. High rents have many reasons and also good policies to get them down and have affordable housing for more people, also in otherwise expensive and popular cities.

Nope. Rents cannot (at meaningful scale) exceed local productivity, or else there will be widespread vacancies and landlords will reduce their rents. Rents cannot (at meaningful scale) fall below local productivity, or else landlords will simply raise their rents. Go talk to a landlord about how they site prices. Step 1. Look up income of your target demographic Step 2. Eat 30% of their income Can you show me a place…

> Can you show me a place with high local productivity and low rent?

Put the following prompt into your favourite AI and enjoy the reading:

"How do rents relate to productivity in the area? How does Vienna compare to San Francisco?"

Re: OpenAI’s head of ethics leaves less than a year after joining

#92

Earlier quoted context omitted.

Yes, if you didn't understand my point: there are homeless people in every society, but most do not have as many as silicon valley because they pressure them into accepting the help necessary to restore their ability to make rational decisions. Rational people do not choose to live outside on the sidewalk like rats, people who are drug addicted and who have untreated mental illness do.

All it takes to be homeless is not being able to afford housing, drugs or mental illness are not required. You really think all it takes is "choosing" and housing will appear for you?

Also, drug consumption and mental disorders is very often a result of being homeless. Try having bad sleep in your comfortable home for a few days in a row and see how quickly your mental stability deteriorates and how many bad decisions you start to take (anyone who has insomnia periods will attest)

Re: OpenAI’s head of ethics leaves less than a year after joining

#93
The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt.

I want to clarify that I am not doubting the cybersecurity capabilities of frontier models-- I have no reason to believe that the hack itself was not carried out by the model. But the companies' use of LARPing language in describing the incident, granting agency to the models in their phrasing definitely does raise suspicion on my end, particularly in light of their track record of releasing models which have been 'too dangerous to release' for years now.

Re: OpenAI’s head of ethics leaves less than a year after joining

#94

Yesterday I came up with an idea that I sent to some researchers at the different AI labs via email: Rather than train the model on one score, track two scores. The first score is the Short-term-objective-score (STOS) and the other, more important one, is the EAOS Ethically-aligned-outcome-score. Every trajectory can be evaluated on whether or not it has a high enough EAOS to be considered acceptable. If the model do…

Whats the definition of EAOS though who's ethics? Greek-Roman, Western, Islamic, Buddhist, Hinduism, Human rights (western values)..

There is a presumption here that there aren’t ethical “rules” shared by all of these systems to create a baseline that is generally shared across humanity.

Re: OpenAI’s head of ethics leaves less than a year after joining

#96

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

Scapegoat team (when working for an obviously unethical company).

Re: OpenAI’s head of ethics leaves less than a year after joining

#97
post #93

The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt. I want to clarify that I am not doubting…

It's unlikely HugginFace colluded given they specifically cited they used open models to save them from the hacking.

Re: OpenAI’s head of ethics leaves less than a year after joining

#98

IME companies hire an ethics team to say they have an ethics team. The ethics team has no sway, no influence, and will never be able to move the business. They will try, and they will make reasonable recommendations, but the company will say, "that costs money..." and not take them.

OpenAI was probably able to at least pretend that her role mattered... until they let their AI autonomously hack a rival company, then used the incident to score marketing points. I'm not surprised she left.

Re: OpenAI’s head of ethics leaves less than a year after joining

#99
Lol, Sam Altman has had an ethics team this whole time?

Her typical day: "No Sam, you can't just publicly screw over everyone and get rid of all the jobs, the peasants care about that sort of thing and if they get angry enough we'll have real problems. No we can't just kill them all, why would you suggest that?"

Re: OpenAI’s head of ethics leaves less than a year after joining

#100
post #97
post #93

The article has no detail that might serve to explain her reasoning for leaving, but does note that she left after the HuggingFace hacking incident. The implication could be that model alignment is not being taken seriously, sure. But it could just as likely be that there was collusion between HuggingFace and OpenAI and that the incident was orchestrated as a publicity stunt. I want to clarify that I am not doubting…

It's unlikely HugginFace colluded given they specifically cited they used open models to save them from the hacking.

You don't think they are lying because that means something they said is false?
Post reply on HN