Live data from Hacker News

AI Ethics is being narrowed on purpose, like privacy was

nimishg.substack.com

121–130 of 130 posts

Re: AI Ethics is being narrowed on purpose, like privacy was

#121

Earlier quoted context omitted.

> I have yet to meet a single AI safety person that knows how to rename a file in linux. You are meeting very few AI safety people then. A significant fraction of the AI safety people I've run into can build and train an LLM from scratch (without AI assistance FWIW), let alone have a grasp of basic command-line operations.

Where are you running into these unicorn AI safety people?

People who have gone through MATS (ML Alignment & Theory Scholars), SPAR (Supervised Program for Alignment Research), ARENA (Alignment Research Engineer Accelerator), or any of those other similar programs.

Re: AI Ethics is being narrowed on purpose, like privacy was

#122
post #117

Earlier quoted context omitted.

This isn't the case, and the hubris is not limited to academia...

I say, this is indeed the case in view of LLM lessons we have learnt along the way—most importantly, Wittgenstein had argued that in order to model language, you first need to model arbitrary discourses—this turned out to be the case (symbolic v. probabilistic) as LLM have shown to perform symbolic computation from learned representations, whilst the inverse has not been shown _ever_. Layman way of formulating this w…

I'm unfamiliar with any philosophers rejecting the discoveries of linguistics, but this has no bearing on ethics and its problems, nor is linguistics 'Wittgensteinian'.

Re: AI Ethics is being narrowed on purpose, like privacy was

#123
post #98

Earlier quoted context omitted.

> I have yet to meet a single AI safety person that knows how to rename a file in linux. I don't know if instead of saying "safety" here you meant to say ethics, or if you're using "safety" in this sentence just to generally refer to "AI ethics, safety, and to a smaller extent privacy." If either of those are true, that's weird because the only person in AI ethics most people know is Timnit Gebru, because she got fir…

Gebru didn't do any AI safety work at Google. She wrote stuff about doing social good, wrote the silly stochastic parrots paper that argued AI research was a waste of time, and whose title was proven false immediately (LLMs aren't parrots). The closest she got to "safety" was complaining that AI researchers weren't concerned enough that LLMs might say things Gebru didn't personally like. Serious safety researchers ar…

> Serious safety researchers are doing stuff like understanding neural circuits. Very different.

There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL".

It's like how computer science safety can be anything and everything from "Should platforms like Meta be required to have a minimum age requirement?" and "Should section 230 provides immunity for online computer services with respect to third-party content generated by its users?", but also "How can we formalise system testing requirements to prove that things like Therac-25 never happens again?" and "Is the Boeing 737 MAX flight control software actually safe?"

Re: AI Ethics is being narrowed on purpose, like privacy was

#124

Humans can’t agree on what is ethical / safe, so I don’t get people trying to apply it to AI. Am I missing something big here? Anytime I see discussion framed as “ethics” my brain swaps ethics with “rules I think are good”.

Right now the deeper problem is that nobody really knows how to reliably and deliberately make AI that's aligned with anything human-like.

As in: it's basically a nice happy accident that LLMs are only sycophantic/fawning and don't normally (ahem, Grok) try to undermine us all like edgy internet trolls.

If we could make them follow even exactly 6 (for sake of argument, no more, no less) of Anton LaVey's Eleven Satanic Rules of the Earth*, and do so reliably instead of the ethics equivalent of a shrug and "LGTM, merged", this would be a big development and make people a lot more comfortable about open models that can do decent work with chemistry or biology.

* https://churchofsatan.com/eleven-rules-of-earth/

Re: AI Ethics is being narrowed on purpose, like privacy was

#125
post #123
post #98

Earlier quoted context omitted.

Gebru didn't do any AI safety work at Google. She wrote stuff about doing social good, wrote the silly stochastic parrots paper that argued AI research was a waste of time, and whose title was proven false immediately (LLMs aren't parrots). The closest she got to "safety" was complaining that AI researchers weren't concerned enough that LLMs might say things Gebru didn't personally like. Serious safety researchers ar…

> Serious safety researchers are doing stuff like understanding neural circuits. Very different. There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL". It's like how computer science safety can be anything and everything from "Should platforms like Meta be require…

I wouldn't describe the first two as computer science safety arguments. Those are purely social and merely the latest iteration of exactly the same debate that occurred around VHS tapes, newspapers, etc. The latter two are very specific to computing.

Re: AI Ethics is being narrowed on purpose, like privacy was

#126
post #125
post #123

Earlier quoted context omitted.

> Serious safety researchers are doing stuff like understanding neural circuits. Very different. There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL". It's like how computer science safety can be anything and everything from "Should platforms like Meta be require…

I wouldn't describe the first two as computer science safety arguments. Those are purely social and merely the latest iteration of exactly the same debate that occurred around VHS tapes, newspapers, etc. The latter two are very specific to computing.

230 is something that couldn't have existed with newspapers, because for "letters to the editor" it's obvious both who the editor is and that this is the opinion of some named public person whose opinion they were willing to reproduce. There may have been such an argument about telephones back in the day, but those are so old now…

Anyway, point is that AI does something new besides "is software" in the same way that computers do something new besides "is electrical" — social implications of ${new_tool} is absolutely relevant to all discussions about ${safety|new_tool}. Don't need to invent motor vehicle licenses or motor vehicles safety requirements or traffic lights before the invention of cars.

Edit: or to put it another way, "yes, and?" — they're still about safety of ${thing}, just a question of what level to improve that safety.

Re: AI Ethics is being narrowed on purpose, like privacy was

#127
post #117

Earlier quoted context omitted.

I say, this is indeed the case in view of LLM lessons we have learnt along the way—most importantly, Wittgenstein had argued that in order to model language, you first need to model arbitrary discourses—this turned out to be the case (symbolic v. probabilistic) as LLM have shown to perform symbolic computation from learned representations, whilst the inverse has not been shown _ever_. Layman way of formulating this w…

I'm unfamiliar with any philosophers rejecting the discoveries of linguistics, but this has no bearing on ethics and its problems, nor is linguistics 'Wittgensteinian'.

Your lack of philosophical education really shows! Linguistics does not "discover" anything; it's purely descriptive, and many philosophers of language in the Cambridge school have, indeed, rejected great bodies thereof. Do you need any pointers? I could oblige.

Re: AI Ethics is being narrowed on purpose, like privacy was

#128
post #127

Earlier quoted context omitted.

I'm unfamiliar with any philosophers rejecting the discoveries of linguistics, but this has no bearing on ethics and its problems, nor is linguistics 'Wittgensteinian'.

Your lack of philosophical education really shows! Linguistics does not "discover" anything; it's purely descriptive, and many philosophers of language in the Cambridge school have, indeed, rejected great bodies thereof. Do you need any pointers? I could oblige.

your comment misses the point entirely.

Re: AI Ethics is being narrowed on purpose, like privacy was

#129
post #73

It's hilarious listening to people talk about AI ethics while their bots like perplexity knock my server offline trying to download 50000 files at once. Thank god for cloudflare.

Are you saying the author of the article is using bots to download files from your server?

i am saying every single AI company has agents using my site, and some have no fucking respect at all and the growing pains have been immense for an independent company like mine (i'd say about a quarter of our dev time this year).

Re: AI Ethics is being narrowed on purpose, like privacy was

#130

Earlier quoted context omitted.

Where are you running into these unicorn AI safety people?

People who have gone through MATS (ML Alignment & Theory Scholars), SPAR (Supervised Program for Alignment Research), ARENA (Alignment Research Engineer Accelerator), or any of those other similar programs.

More generally a lot of the denizens on https://www.alignmentforum.org/
Post reply on HN