Live data from Hacker News

Pivot to AI safety, I beg you

ceselder.substack.com

11–15 of 15 posts

Re: Pivot to AI safety, I beg you

#11
The most likely path I see for human survival and flourishing is for AI to do something in the near future so destructive and terrifying that it unites humanity behind permanently banning it at any cost.

It therefore seems like "AI safety" people may actually be working against our safety.

Re: Pivot to AI safety, I beg you

#12
post #9

I’ve decided that the third Industrial Revolution is a foregone conclusion, so I’ve pivoted to try to make it better for everybody, not just corporations and governments. If we do it right, at least we will get a new washing machine* out of it. I also think our work will help to underpin safety, and that actually a big deal, because as it turns out safety isn’t a bolt-on. It must be something resembling character, or…

What is it you’re doing?

Re: Pivot to AI safety, I beg you

#13
post #3

The reason I don’t pivot into AI safety (in a topic I might have comparative advantage in as a mathematician) is the following. (1) I believe increasing AI capability is a net negative. (2) AI capability is limited by AI safety in the way the power of a rifle is limited by how safe it is to use. I.e., AI safety and AI capability look like two sides of a coin to me. If I were disillusioned of this view I might conside…

I'm confused. Shouldn't you conclude it's unethical /not/ to support safety research based off your own points.

My understanding of "safety" is that it means formalising morality, ensuring AI doesn't go astray as it recursively improves it's self, destroying our future in some horrifying way possibly worse than death.

Re: Pivot to AI safety, I beg you

#14
post #13
post #3

The reason I don’t pivot into AI safety (in a topic I might have comparative advantage in as a mathematician) is the following. (1) I believe increasing AI capability is a net negative. (2) AI capability is limited by AI safety in the way the power of a rifle is limited by how safe it is to use. I.e., AI safety and AI capability look like two sides of a coin to me. If I were disillusioned of this view I might conside…

I'm confused. Shouldn't you conclude it's unethical /not/ to support safety research based off your own points. My understanding of "safety" is that it means formalising morality, ensuring AI doesn't go astray as it recursively improves it's self, destroying our future in some horrifying way possibly worse than death.

Is a misaligned AI worse than a super - capable AI aligned with corporate interest? Because I can't really tell anymore.

Re: Pivot to AI safety, I beg you

#15
post #12
post #9

I’ve decided that the third Industrial Revolution is a foregone conclusion, so I’ve pivoted to try to make it better for everybody, not just corporations and governments. If we do it right, at least we will get a new washing machine* out of it. I also think our work will help to underpin safety, and that actually a big deal, because as it turns out safety isn’t a bolt-on. It must be something resembling character, or…

What is it you’re doing?

tracedynamics.ai

Some of my ideas on AI safety at https://ctsmyth.substack.com/p/all-you-need-is-character

Post reply on HN