Earlier quoted context omitted.
> I have yet to meet a single AI safety person that knows how to rename a file in linux. You are meeting very few AI safety people then. A significant fraction of the AI safety people I've run into can build and train an LLM from scratch (without AI assistance FWIW), let alone have a grasp of basic command-line operations.
Where are you running into these unicorn AI safety people?
AI Ethics is being narrowed on purpose, like privacy was
121–130 of 130 posts
Re: AI Ethics is being narrowed on purpose, like privacy was
#122Earlier quoted context omitted.
This isn't the case, and the hubris is not limited to academia...
I say, this is indeed the case in view of LLM lessons we have learnt along the way—most importantly, Wittgenstein had argued that in order to model language, you first need to model arbitrary discourses—this turned out to be the case (symbolic v. probabilistic) as LLM have shown to perform symbolic computation from learned representations, whilst the inverse has not been shown _ever_. Layman way of formulating this w…
Re: AI Ethics is being narrowed on purpose, like privacy was
#123Earlier quoted context omitted.
> I have yet to meet a single AI safety person that knows how to rename a file in linux. I don't know if instead of saying "safety" here you meant to say ethics, or if you're using "safety" in this sentence just to generally refer to "AI ethics, safety, and to a smaller extent privacy." If either of those are true, that's weird because the only person in AI ethics most people know is Timnit Gebru, because she got fir…
Gebru didn't do any AI safety work at Google. She wrote stuff about doing social good, wrote the silly stochastic parrots paper that argued AI research was a waste of time, and whose title was proven false immediately (LLMs aren't parrots). The closest she got to "safety" was complaining that AI researchers weren't concerned enough that LLMs might say things Gebru didn't personally like. Serious safety researchers ar…
There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL".
It's like how computer science safety can be anything and everything from "Should platforms like Meta be required to have a minimum age requirement?" and "Should section 230 provides immunity for online computer services with respect to third-party content generated by its users?", but also "How can we formalise system testing requirements to prove that things like Therac-25 never happens again?" and "Is the Boeing 737 MAX flight control software actually safe?"
Re: AI Ethics is being narrowed on purpose, like privacy was
#124Humans can’t agree on what is ethical / safe, so I don’t get people trying to apply it to AI. Am I missing something big here? Anytime I see discussion framed as “ethics” my brain swaps ethics with “rules I think are good”.
As in: it's basically a nice happy accident that LLMs are only sycophantic/fawning and don't normally (ahem, Grok) try to undermine us all like edgy internet trolls.
If we could make them follow even exactly 6 (for sake of argument, no more, no less) of Anton LaVey's Eleven Satanic Rules of the Earth*, and do so reliably instead of the ethics equivalent of a shrug and "LGTM, merged", this would be a big development and make people a lot more comfortable about open models that can do decent work with chemistry or biology.
Re: AI Ethics is being narrowed on purpose, like privacy was
#125Earlier quoted context omitted.
Gebru didn't do any AI safety work at Google. She wrote stuff about doing social good, wrote the silly stochastic parrots paper that argued AI research was a waste of time, and whose title was proven false immediately (LLMs aren't parrots). The closest she got to "safety" was complaining that AI researchers weren't concerned enough that LLMs might say things Gebru didn't personally like. Serious safety researchers ar…
> Serious safety researchers are doing stuff like understanding neural circuits. Very different. There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL". It's like how computer science safety can be anything and everything from "Should platforms like Meta be require…
Re: AI Ethics is being narrowed on purpose, like privacy was
#126Earlier quoted context omitted.
> Serious safety researchers are doing stuff like understanding neural circuits. Very different. There's a very broad range of unsolved safety issues in AI, and what she does is perfectly validly in that category even though she herself will deny the value of anything in the general category of "TESCREAL". It's like how computer science safety can be anything and everything from "Should platforms like Meta be require…
I wouldn't describe the first two as computer science safety arguments. Those are purely social and merely the latest iteration of exactly the same debate that occurred around VHS tapes, newspapers, etc. The latter two are very specific to computing.
Anyway, point is that AI does something new besides "is software" in the same way that computers do something new besides "is electrical" — social implications of ${new_tool} is absolutely relevant to all discussions about ${safety|new_tool}. Don't need to invent motor vehicle licenses or motor vehicles safety requirements or traffic lights before the invention of cars.
Edit: or to put it another way, "yes, and?" — they're still about safety of ${thing}, just a question of what level to improve that safety.
Re: AI Ethics is being narrowed on purpose, like privacy was
#127Earlier quoted context omitted.
I say, this is indeed the case in view of LLM lessons we have learnt along the way—most importantly, Wittgenstein had argued that in order to model language, you first need to model arbitrary discourses—this turned out to be the case (symbolic v. probabilistic) as LLM have shown to perform symbolic computation from learned representations, whilst the inverse has not been shown _ever_. Layman way of formulating this w…
I'm unfamiliar with any philosophers rejecting the discoveries of linguistics, but this has no bearing on ethics and its problems, nor is linguistics 'Wittgensteinian'.
Re: AI Ethics is being narrowed on purpose, like privacy was
#128Earlier quoted context omitted.
I'm unfamiliar with any philosophers rejecting the discoveries of linguistics, but this has no bearing on ethics and its problems, nor is linguistics 'Wittgensteinian'.
Your lack of philosophical education really shows! Linguistics does not "discover" anything; it's purely descriptive, and many philosophers of language in the Cambridge school have, indeed, rejected great bodies thereof. Do you need any pointers? I could oblige.
Re: AI Ethics is being narrowed on purpose, like privacy was
#129It's hilarious listening to people talk about AI ethics while their bots like perplexity knock my server offline trying to download 50000 files at once. Thank god for cloudflare.
Are you saying the author of the article is using bots to download files from your server?
Re: AI Ethics is being narrowed on purpose, like privacy was
#130Earlier quoted context omitted.
Where are you running into these unicorn AI safety people?
People who have gone through MATS (ML Alignment & Theory Scholars), SPAR (Supervised Program for Alignment Research), ARENA (Alignment Research Engineer Accelerator), or any of those other similar programs.