Live data from Hacker News

Microsoft lays off one of its responsible AI teams

platformer.news

291–300 of 466 posts

Re: Microsoft lays off one of its responsible AI teams

#291

Earlier quoted context omitted.

Who’s checking the karma of posters on Reddit?

Some subs have karma requirements for posting or commenting.

Some subs only allow historians, some subs only allow women, some subs only allow students at a specific university.

I don’t think one’s access to different subreddits is something anyone should waste brain cycles on, many bigger fish to fry :)

Re: Microsoft lays off one of its responsible AI teams

#292

End of the day the AI space will be dominated by whatever model doesn’t lecture you about “as a large language model I can’t…”. And the company that will ship that won’t have the largest “AI safety and ethics” team. ChatGPT will become as irrelevant as Dall-E2 when that happens. (Not saying this is for the best, just saying what I think will happen)

Depends. As with Internet forums, the presence of Nazis (or whatever similar bad actor) could ruin it for everyone else.

Let’s say you are a high schooler writing an essay about WWII. You ask Google LLM about it, and it starts writing Neo Nazi propaganda about how the holocaust was a hoax, but even if it wasn’t, it would have been fine. The reason it’s telling you those things is because it’s been trained by Neo Nazi content which either wasn’t filtered out of the training set or was added by Neo Nazi community members in production usage.

Either way, now no one wants to listen to your LLM except Neo Nazis. Congrats, you’ve played yourself.

FYI, the reason no one uses Dall-E is because the results are of higher quality in other offerings like Midjourney, which itself does have a content filter.

Re: Microsoft lays off one of its responsible AI teams

#293

Earlier quoted context omitted.

This. People should understand AI safety != AI ethics. AI safety has two branches, AI ethics and AI alignment. Those two branches despise each other with intense passion. The alignment branch (responsible for developing RLHF->ChatGPT) believes AI ethics is completely trivial, and distracts attention away from existential risks. The ethics branch (responsible for all the media attention about racist AIs/bias etc) view…

Sorry, what is RLHF?

[deleted]

Re: Microsoft lays off one of its responsible AI teams

#294
post #278

These sorts of adjunct, off-to-the-side "ethics" teams are always corporate window dressing, and when push comes to shove they always get jettisoned when competition demands an increase in speed. I don't mean to start a flame war, but this is a reason why I think "Chief Diversity Officers" are such an ill-conceived notion. It's not that I don't think diversity in corporate environments is extremely valuable, but it's…

Almost entirely, the existence of Chief Diversity Officers - and to a lesser but still prevalent extent, this "off-to-the-side" teams you mention - are just jobs programs with an identity politics twist. CDOs exist so that the "right" people can have a high-power (even if only via public perception), well-paid C-suite role. These ethics teams exist so that a group of the "right" people can level up their resumes. Ins…

More than being created to create jobs, I suspect things like ethics teams are mainly created for PR purposes, to make the company look good -- and in fact, the "product" they are expected to produce are defenses against the company looking bad, keep the actual product teams from doing things that make the company look bad. (Whether they are given the tools to succeed at this is another question, but it's not like people not given the tools to succeed at large organizations is unusual!)

If an AI product makes Microsoft look really bad publicly due to something understood by the public as an ethical concern, the ethics team will be back.

Re: Microsoft lays off one of its responsible AI teams

#295
post #115

Anyone paying close attention to the output of generic "AI ethics" people (especially on Twitter) should not be surprised that companies that when push comes to shove the businesses getting actually useful AI tools that are being tested by real people for real things generating real data, are starting to question the utility of the bulk of the crowd who skirted off hypotheticals for years to build their reputations a…

Yeah I think the question is are these people just philosophers pontificating about AI doom, or are they AI researchers creating techniques to make AI decisions less opaque and biased (or less biased in undesirable ways at least)? The latter are definitely useful but the former is something you start so you can look good and then disband a few years later when they produce little useful output and cost a ton of money…

“On the other hand, everyone involved in the development of AI agrees that the technology poses potent and possibly existential risks, both known and unknown. Tech giants have taken pains to signal that they are taking those risks seriously — Microsoft alone has three different groups working on the issue, even after the elimination of the ethics and society team. But given the stakes, any cuts to teams focused on responsible work seem noteworthy.”

Re: Microsoft lays off one of its responsible AI teams

#296

End of the day the AI space will be dominated by whatever model doesn’t lecture you about “as a large language model I can’t…”. And the company that will ship that won’t have the largest “AI safety and ethics” team. ChatGPT will become as irrelevant as Dall-E2 when that happens. (Not saying this is for the best, just saying what I think will happen)

[deleted]

Re: Microsoft lays off one of its responsible AI teams

#297

These sorts of adjunct, off-to-the-side "ethics" teams are always corporate window dressing, and when push comes to shove they always get jettisoned when competition demands an increase in speed. I don't mean to start a flame war, but this is a reason why I think "Chief Diversity Officers" are such an ill-conceived notion. It's not that I don't think diversity in corporate environments is extremely valuable, but it's…

Everyone is agreeing with this comment.

That's awesome, I do too!

But, OP felt they had to post with throwaway account. And so do I.

This also speaks volumes.

Re: Microsoft lays off one of its responsible AI teams

#298
post #104

Earlier quoted context omitted.

Yeah, this is like claiming lead ethyl in gas “hasn’t caused mass harm” in 1954. There’s absolutely zero way to know that yet.

The problem with measuring the "harm" of something like AI vs e.g. lead is that with lead there are direct first order chemical harmful effects that are indisputable. With AI, any harm will get expressed via complex social dynamics, which involve so many other variables as well.

Okay, so for leaded petrol substitute mortgage backed securities. The person who invented those was not going “buahahah, fly my pretties, cause a global financial crisis”; they probably thought they were doing a _good, ultimately of benefit to society thing_. And yet…

Re: Microsoft lays off one of its responsible AI teams

#299

Earlier quoted context omitted.

Am I supposed to know these terms?

Sorry, yes that wasn't clear. Scott Alexander coined most of them in "I can tolerate anything except the outgroup" [1] Red & blue are exactly what a U.S reader would think they are. "Grey" is an attempt by Scott to define something else, loosely hacker-ish / rationalist (you can tell who he thinks the cool people are). "Rainbow tribe" I just made up, but I think you can guess what I mean now based on context. Alignme…

My interpretation:

Red = Republicans/Conservatives

Blue = Democrats/Liberals (in the US sense, not classical liberals)

Grey = Liberterian/Rationalists

Rainbow = LGBTQ+, usually a subset of the Blue tribe in the US

Re: Microsoft lays off one of its responsible AI teams

#300

Earlier quoted context omitted.

Am I supposed to know these terms?

Sorry, yes that wasn't clear. Scott Alexander coined most of them in "I can tolerate anything except the outgroup" [1] Red & blue are exactly what a U.S reader would think they are. "Grey" is an attempt by Scott to define something else, loosely hacker-ish / rationalist (you can tell who he thinks the cool people are). "Rainbow tribe" I just made up, but I think you can guess what I mean now based on context. Alignme…

Gray: confederate army

Blue: union army

Red: British army

Rainbow: Lovely, prismatic army that covers everyone else?

I still don't understand. You're saying words of import without landing the plane, IMHO.

Post reply on HN