Grok and the Naked King: The Ultimate Argument Against AI Alignment
61–70 of 75 posts
Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#62The argument against AI alignment is that humans aren't aligned either. Humans (and other life) are also self-perpetuating and mutating. We could produce a super intelligence that is against us at any moment! Should we "take steps" to ensure that doesn't happen? If not, then what's the argument there? That life hasn't caused a catastrophe so far, therefore it's not going to in the future? The arguments are the same f…
Elon got singled out because the changes he was forcing on grok were both conspicuously stupid (grok ranting about boers), racist (boers again), and ultimately ineffective (repeat incidents of him fishing for an answer and getting a different one). It does actually matter what the values are when trying to do "alignment". Although you are absolutely right that we've not solved for human alignment, putting a real limi…
Either way, outsourcing opinion to an LLM is dangerous no matter where you fall in the political spectrum.
Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#63The argument against AI alignment is that humans aren't aligned either. Humans (and other life) are also self-perpetuating and mutating. We could produce a super intelligence that is against us at any moment! Should we "take steps" to ensure that doesn't happen? If not, then what's the argument there? That life hasn't caused a catastrophe so far, therefore it's not going to in the future? The arguments are the same f…
Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#64Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#65The argument against AI alignment is that humans aren't aligned either. Humans (and other life) are also self-perpetuating and mutating. We could produce a super intelligence that is against us at any moment! Should we "take steps" to ensure that doesn't happen? If not, then what's the argument there? That life hasn't caused a catastrophe so far, therefore it's not going to in the future? The arguments are the same f…
The difference is the power people have. A single person has no capacity to spread their specific perspective to tens of millions of people, who take it as gospel. And that person, typically, cannot be made to change their perspective at will.
Or a more recent example would be the "misinformation craze" we had going on since years ago. That seems to have fallen away when it became apparent that many fact checkers were politically aligned.
The concept of "memes" in a more general sense is a counterargument too. Viral ideas are precisely a way of one person spreading their perspective to tens of millions.
You could even argue that the current AI bubble building up is a hype cycle that went out of control.
These are all examples of very few people impacting the beliefs of millions.
Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#66Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#67I find these arguments excessively pessimistic in a way that isn’t useful. On the one hand I don’t really love Claude, because I find it excessively obedient, it basically wants to follow me through my thought process whatever that is. Every once in a lone while it might disagree with me, but not often, and while that may say something about me, I suspect it also says something about Claude. But this to me is maybe t…
Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#68Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#69Re: Grok and the Naked King: The Ultimate Argument Against AI Alignment
#70I find these arguments excessively pessimistic in a way that isn’t useful. On the one hand I don’t really love Claude, because I find it excessively obedient, it basically wants to follow me through my thought process whatever that is. Every once in a lone while it might disagree with me, but not often, and while that may say something about me, I suspect it also says something about Claude. But this to me is maybe t…
Why can't you instruct Claude to provide (constructive) opposing views, (better) alternative ideas, etc.