Live data from Hacker News

AI Ethics is being narrowed on purpose, like privacy was

nimishg.substack.com

11–20 of 130 posts

Re: AI Ethics is being narrowed on purpose, like privacy was

#12
> If we give companies unending hype, near unlimited government and scientific resources, all of our personal data including thoughts and behavior patterns, how do we know their leaders will do what we want them to, and not try to subvert us and… take over the world? How do we know they stay on humanity’s side?

I've been saying this for a while

malevolent unaligned entities have already been deployed, in direct control of trillions of dollars of resources

they're called: Mark Zuckerberg, Larry Page, Elon Musk, Sam Altman

"AI" simply increases the scale of the damage they can inflict, given they'll now need far fewer humans to be involved in enacting their will upon humanity

Re: AI Ethics is being narrowed on purpose, like privacy was

#13
post #7

AI ethics are like nuclear ethics: the incentive to break them is too powerful without every major player becoming a signatory to some agreement with consequences that have teeth.

If you have the time, check out the show "Pantheon" (it should be on Netflix). It goes into this and how effectively AI ethics goes out the window when the reward for breaking them means nation-dominating power.

Re: AI Ethics is being narrowed on purpose, like privacy was

#14
post #12

> If we give companies unending hype, near unlimited government and scientific resources, all of our personal data including thoughts and behavior patterns, how do we know their leaders will do what we want them to, and not try to subvert us and… take over the world? How do we know they stay on humanity’s side? I've been saying this for a while malevolent unaligned entities have already been deployed, in direct contr…

Distribute power or go home. Something missed by many in these conversations is the role of open source in raising the floor so that we have a gazillion companies that have more interest in there being a fair, predictable market than a winner-take-all market.

Re: AI Ethics is being narrowed on purpose, like privacy was

#15
post #8

This has been happening for a long time. I first noticed this with the hand waving dismissals of older concepts like Asimov’s laws. Not a carefully reasoned argument why “not causing harm to a human” is outmoded, but just pushing it aside. I would love to see a good reasoned argument there. No, instead there is Avoiding talking about harm to humans. Just because harm is broad doesn’t get you out of having to talk abo…

Not hand waving, Asimov’s three laws are not a good framework. My claim is that the whole point was so that Asimov could write entertaining stories about the ambiguities and edge cases of the three laws.

Re: AI Ethics is being narrowed on purpose, like privacy was

#16

It seems to me that this article is the one prevaricating between "ethics" and "safety". The latter is of course a narrow subset of the former, as there are many ethics issues that are not safety issues.

Safety is about unintentional harm to yourself or others. Ethics largely concern themselves with intentional behavior.

Re: AI Ethics is being narrowed on purpose, like privacy was

#17
post #15
post #8

This has been happening for a long time. I first noticed this with the hand waving dismissals of older concepts like Asimov’s laws. Not a carefully reasoned argument why “not causing harm to a human” is outmoded, but just pushing it aside. I would love to see a good reasoned argument there. No, instead there is Avoiding talking about harm to humans. Just because harm is broad doesn’t get you out of having to talk abo…

Not hand waving, Asimov’s three laws are not a good framework. My claim is that the whole point was so that Asimov could write entertaining stories about the ambiguities and edge cases of the three laws.

This is a pretty good example of what parent comment was referencing, I think.

You say "Asimov’s three laws are not a good framework.", then don't present any arguments to why it is not a good framework. Instead you bring up something separate: the framework can facilitate story writing.

It could be good for story writing and a good framework. Those two aren't mutually exclusive things. (I'm not arguing that it is a good framework or not, I haven't thought about it enough)

Re: AI Ethics is being narrowed on purpose, like privacy was

#18
post #8

This has been happening for a long time. I first noticed this with the hand waving dismissals of older concepts like Asimov’s laws. Not a carefully reasoned argument why “not causing harm to a human” is outmoded, but just pushing it aside. I would love to see a good reasoned argument there. No, instead there is Avoiding talking about harm to humans. Just because harm is broad doesn’t get you out of having to talk abo…

I think a big factor in Asimov's laws specifically being sidelined is that the whole process of building AI looks very different from what we pictured back then.

Instead of us programming the AIs by feeding it lots of explicit hand-crafted rules/instructions, we're feeding the things with plain data instead, and the resulting behavior is much more black-box, less predictable and less controllable than anticipated.

Training LLMs is closer, conceptually, to raising children than to implementing regexp parsers, and the whole "small simple set of universal constraints" is just not really applicable/useful.

Re: AI Ethics is being narrowed on purpose, like privacy was

#19

I keep seeing "AI ethics" being redefined to focus on fictional problems instead of real-world ones, so I wrote a little post on it.

Great little post. Congrats. Also there's the ethics of scraping the whole internet and claiming that it's all fair use, because the other scenario is a little too inconvenient for all the companies involved. P.S.: I expect a small thread telling me that it's indeed fair use, because models "learn and understand just like humans", and "models are hugely transformative" (even though some licenses say "no derivatives w…

IP is a pragmatic legal fiction, created to reward developers of creative and innovative thought, so we get more of it. It’s not a natural law.

As such fair use is whatever the courts say it is.

Re: AI Ethics is being narrowed on purpose, like privacy was

#20

I keep seeing "AI ethics" being redefined to focus on fictional problems instead of real-world ones, so I wrote a little post on it.

Great little post. Congrats. Also there's the ethics of scraping the whole internet and claiming that it's all fair use, because the other scenario is a little too inconvenient for all the companies involved. P.S.: I expect a small thread telling me that it's indeed fair use, because models "learn and understand just like humans", and "models are hugely transformative" (even though some licenses say "no derivatives w…

Thanks! Yeah, there's a lot of "well, it's 'standard practice' now so it can't be wrong" going on in so many different ways here too...
Post reply on HN