Live data from Hacker News

AI Ethics is being narrowed on purpose, like privacy was

nimishg.substack.com

111–120 of 130 posts

Re: AI Ethics is being narrowed on purpose, like privacy was

#111
post #56

The problem with AI ethics, safety and to a smaller extent, privacy groups is that the priority of the work/message is not placed on the practicality of solving the problem, or i.e. calculating improving affordability of food/housing, but is placed,as evident on this article too, on the lack of "governance structures". In other words the priority of the work is to get these types of people into positions where they d…

Amen.

Re: AI Ethics is being narrowed on purpose, like privacy was

#112
post #48
post #11

I don't know why people allow others to proclaim they're 'ethicists' if they have no relevant philosophical education. There are whole fields of 'ethics' that are just PR departments trying to escape the now bad connotations of 'PR departments'.

It could be the case that Wittgensteinians have won completely, and if that is, indeed, the case—a great chunk of academic ethics should be considered hubris...

This isn't the case, and the hubris is not limited to academia...

Re: AI Ethics is being narrowed on purpose, like privacy was

#113
post #8

This has been happening for a long time. I first noticed this with the hand waving dismissals of older concepts like Asimov’s laws. Not a carefully reasoned argument why “not causing harm to a human” is outmoded, but just pushing it aside. I would love to see a good reasoned argument there. No, instead there is Avoiding talking about harm to humans. Just because harm is broad doesn’t get you out of having to talk abo…

I think a big factor in Asimov's laws specifically being sidelined is that the whole process of building AI looks very different from what we pictured back then. Instead of us programming the AIs by feeding it lots of explicit hand-crafted rules/instructions, we're feeding the things with plain data instead, and the resulting behavior is much more black-box, less predictable and less controllable than anticipated. Tr…

> Training LLMs is closer, conceptually, to raising children than to implementing regexp parsers

Well then that's terrifying - the problem with children is that you can raise them perfectly and they still end up psychos. That's mostly limited by the fact that we can't raise many children and humans are pretty limited in the damage they can do.

But AI scales infinitely, and if we give it access to too much stuff then the damage it could do could be human race ending.

Re: AI Ethics is being narrowed on purpose, like privacy was

#114
post #40
post #35

Earlier quoted context omitted.

It's kinda hilarious that people are explicitly trying to build a future based on (mostly dystopian) scifi, which was the point of the torment nexus thing. But then when scifi argues for constraints on technology the argument is "those are just stories."

The argument isn't "those are just stories" it's that "those stories demonstrate why those constraints won't work." But people are going to try it anyway. Belief in Asimov's three laws is a matter of religious faith. Just know you've been warned.

Trying to have constraints and then failing is arguably better than the current idea about AI safety - discarding constraints as a concept.

If Asimov's laws don't work, that doesn't mean we can ignore the idea of them and... Just do nothing.

Re: AI Ethics is being narrowed on purpose, like privacy was

#115

Humans can’t agree on what is ethical / safe, so I don’t get people trying to apply it to AI. Am I missing something big here? Anytime I see discussion framed as “ethics” my brain swaps ethics with “rules I think are good”.

Sure, but we still need to apply some ethics to AI.

Like, murder is bad, and some people disagree. Don't think that means we need to give AI access to murder. Certainly don't want to be giving them any guns.

The danger here is that we fall into a lazy "we tried nothing and we're all out of ideas" stance and then just recreate the entire plot of Terminator. We should probably do something.

Re: AI Ethics is being narrowed on purpose, like privacy was

#116
post #40

Earlier quoted context omitted.

The argument isn't "those are just stories" it's that "those stories demonstrate why those constraints won't work." But people are going to try it anyway. Belief in Asimov's three laws is a matter of religious faith. Just know you've been warned.

Trying to have constraints and then failing is arguably better than the current idea about AI safety - discarding constraints as a concept. If Asimov's laws don't work, that doesn't mean we can ignore the idea of them and... Just do nothing.

>If Asimov's laws don't work, that doesn't mean we can ignore the idea of them and... Just do nothing.

I don't think anyone is suggesting to just do nothing because Asimov's laws won't work, so much as suggest that people consider why they wouldn't work, and what that means for the problem of AI alignment in the real world.

It may simply be inevitable that AI (if we're defining AI as something like an LLM) can always be talked into or out of anything, given the right prompts. In which case constraints can only work so far and we need to consider what happens when they inevitably fail.

Re: AI Ethics is being narrowed on purpose, like privacy was

#117
post #48

Earlier quoted context omitted.

It could be the case that Wittgensteinians have won completely, and if that is, indeed, the case—a great chunk of academic ethics should be considered hubris...

This isn't the case, and the hubris is not limited to academia...

I say, this is indeed the case in view of LLM lessons we have learnt along the way—most importantly, Wittgenstein had argued that in order to model language, you first need to model arbitrary discourses—this turned out to be the case (symbolic v. probabilistic) as LLM have shown to perform symbolic computation from learned representations, whilst the inverse has not been shown _ever_. Layman way of formulating this would be along the lines of "word definitions do not matter, application of words alone is what matters." IMHO, the language-game framework is so much more valuable, in terms of intuition, than anything outside of language philosophy, & pretty much all of linguistics in the first place: think Chomsky et al.

Wittgensteinians won, and we should hope that philosophy department freaks eventually catch on to this reality.

Re: AI Ethics is being narrowed on purpose, like privacy was

#118
I see two main types of 'AI safety': (a) Safety for the business providing the model. This includes a censorship layer, system promoting, & other means of preventing the AI from giving offensive/controversial/illegal output. A lot of effort goes into this & it's somewhat effective, although it's often useless or unhelpful to end users & doesn't address big-picture concerns. (b) The science fiction idea of a means to control a hypothetical AI with unbounded powers, to make sure it only uses those powers "for good". This type of safety is still speculative fiction & often assumes the AI will have agency & motivations, as well as abilities, that we see no evidence of at present. This would address big-picture concerns, but it's not a real thing, at least not yet.

It remains to be seen whether (b) will be needed, or for that matter, possible.

There are a lot of other ethical questions around AI too, although they mostly aren't unique to it. E.g. AI is increasingly relevant in ethical discussions around misinformation, outsourcing of work, social/cultural biases, human rights, privacy, legal responsibility, intellectual property, etc., but these topics predate LLMs by many years.

Re: AI Ethics is being narrowed on purpose, like privacy was

#119
post #98

Earlier quoted context omitted.

Gebru didn't do any AI safety work at Google. She wrote stuff about doing social good, wrote the silly stochastic parrots paper that argued AI research was a waste of time, and whose title was proven false immediately (LLMs aren't parrots). The closest she got to "safety" was complaining that AI researchers weren't concerned enough that LLMs might say things Gebru didn't personally like. Serious safety researchers ar…

> Gebru didn't do any AI safety work at Google Wouldn't you find it strange for a co-lead of an Ethical AI team to not to do any AI safety work? I realize the AI Doomer vs AI Zoomer is a culture-war with a veneer or technical jargon, but I hope we can at least agree on the basic tenets of our shared reality even as we draw wildly different conclusions.

Not really. Ethics asks, "is this good?". Safety asks, "how do we make this safe?" - very different questions.

Re: AI Ethics is being narrowed on purpose, like privacy was

#120
post #24

Earlier quoted context omitted.

You might not be aware of the context (actually the author of the article might not either). There has in fact been a big push by major AI companies to focus on quote safety unquote while marginalizing (not citing, giving attention to, etc) people focusing on what those companies call quote ethics unquote. For example, from Timnit Gebru: > The fact that they call themselves "AI Safety" and call us "AI Ethics" is very…

There has been a big push by major AI companies to focus on "safety", which they understand to refer to the novel types of harm that a powerful AI model might cause. It's true that some people are confident there's no such novelty, and it's impossible for an AI system to cause a problem which can't be analyzed within the frameworks we've developed for human misbehavior. Some of those people do say that if you don't a…

Your second paragraph doesn't match the dialogue around the topic that I've encountered.

I generally agree with your first paragraph. My summary of the critique on "safety vs ethics" is that the push to focus on "novel" types of harm has come with dismissing and glossing over of AI reproducing and amplifying existing harms. These are well documented in machine learning from the pre-LLM era (e.g. books like Weapons of Math Destruction).

Post reply on HN