Live data from Hacker News

Meta disbanded its Responsible AI team

theverge.com

221–230 of 409 posts

Re: Meta disbanded its Responsible AI team

#222

Earlier quoted context omitted.

In other news, police is not needed because everyone should just behave.

But there are no responsible X teams for many X. But AI gets one. (Here X is a variable not Twitter)

There are plenty of ethics teams in many industries, I don’t think this is a great point to make.

Re: Meta disbanded its Responsible AI team

#223
post #221

Google removed "Don't be evil", so we know they do evil. Facebook disbaneded responsible AI team, so we know they do AI irresponsibly. I love greedy evil corporations telling on themselves.

i don’t!! these are blinking red lights with no easy fix!

On the contrary, the fix is trivial: Don't give them any money.

Re: Meta disbanded its Responsible AI team

#224
post #167

Earlier quoted context omitted.

We haven't formalized ethics to the point of it being a multiplayer puzzle game for adults.

Isn't that what religion in general, and becoming a Doctor of Theology in particular, is? https://en.wikipedia.org/wiki/Doctor_of_Theology

Quite possibly yes, and I personally grew up in a cult of Bible lawyers so I can imagine it, but here we are talking corporate ethics (an oxymoron) and AI alignment, which are independent of religion.

Re: Meta disbanded its Responsible AI team

#225
post #204

Earlier quoted context omitted.

A good argument for independent regulation/oversight.

Independent is the tricky part. AI companies already are asking for government regulation but how independent would that regulation really be?

As independent as any other government oversight/regulation in the US, it'd either be directly run or heavily influenced by those being regulated.

Re: Meta disbanded its Responsible AI team

#226
post #182

Earlier quoted context omitted.

Would you have called the possibility of large language models helping millions of people "unhinged" a few years ago as well?

No? That’s been the goal of NLP and information retrieval research for decades.

The goal is also to develop systems that are significantly more capable than current systems. And those systems could be misused when terrorists gain access to them. What about that is "unhinged"?

Re: Meta disbanded its Responsible AI team

#227
post #198
post #191

Earlier quoted context omitted.

> Nobody’s taking those instructions and building out a lab successfully who doesn’t already know what they’re doing haha. Long may it remain so; but you can only be sure of that by having some people trying to red team the models you release before publishing the weights. If you don't, and the model can, you can't ever undo publication. Getting the models good enough to do that seems extremely plausible to me, given…

I just don’t see the danger. There isn’t anything you couldn’t find on 4chan in a few clicks. And the bioweapons example is a pointer to RefSeq? Come on. These efforts just don’t stand up to scrutiny. They risk appearing unserious to people outside the responsible AI world. I think there are better places to spend time. Edit: > If you don't, and the model can, you can't ever undo publication. We’re talking about a mo…

> I just don’t see the danger. There isn’t anything you couldn’t find on 4chan in a few clicks.

Making something 100x easier and convenient creates an entirely new scenario. There's illegal content all over the dark web, and accessing it is easy if you are technically inclined. Now, if ChatGPT would simply give you that material by just asking it in plain English, you are creating a new threat. It is absolutely legitimate to investigate how to mitigate such risks.

Re: Meta disbanded its Responsible AI team

#228
post #138

Earlier quoted context omitted.

not sure it's fair to trivialize ai risks. for just one example, the pen is mightier than the sword.

I’m not trivializing risks. I’m characterizing output. These systems aren’t theoretical anymore. They’re used by hundreds of millions of people daily in one form or another. What are these teams accomplishing? Give me a concrete example of a harm prevented. “Pen is mightier than the sword” is an aphorism.

Production LLM’s have been modified to avoid showing kids how to make dangerous chemicals using household chemicals. That’s a specific hazard being mitigated.

Re: Meta disbanded its Responsible AI team

#229
post #193

It never made any organizational sense for me to have a "responsible AI team" in the first place. Every team doing AI work should be responsible and should think about the ethical (and legal at a bare minimum baseline) dimension of what they are doing. Having that concentrated in a single team means that team becomes a bottleneck where they have to vet all AI work everyone else does for responsibility and/or everyone…

Do companies need an info sec team?

They do, but I would argue that app sec is the responsibility of the development teams. Infosec can and should have a role in helping devs to follow good app sec practises, but having a seperate app sec team that don't have anything to do with app development seems unlikely to be the best model.

Re: Meta disbanded its Responsible AI team

#230
post #220

It never made any organizational sense for me to have a "responsible AI team" in the first place. Every team doing AI work should be responsible and should think about the ethical (and legal at a bare minimum baseline) dimension of what they are doing. Having that concentrated in a single team means that team becomes a bottleneck where they have to vet all AI work everyone else does for responsibility and/or everyone…

the people I’ve seen doing responsible AI say they have a hell of a time getting anyone to care about responsibility, ethics, and bias. of course the worst case is when this responsibility is both outsourced (“oh it’s the rAI team’s job to worry about it”) and disempowered (e.g. any rAI team without the ability to unilaterally put the brakes on product decisions) unfortunately, the idea that AI people effectively sel…

The idea that any for-profit company can self-govern without external accountability is also magical thinking

A "Responsible AI Team" at a for-profit was always marketing (sleight of hand) to manipulate users.

Just see OpenAI today: safety vs profit, who wins?

Post reply on HN