11–20 of 137 posts
"This is not an unreasonable thing to do, given that they have a global audience"
Clearly that was not their motivation. In fact I'd argue that it's the global audience that were most annoyed by this.
In a nutshell for those without a X account: the problem here isn't that Google's AI gave "woke" results. The big problem here is that even one of the biggest AI specialists in the world, Google, wasn't able to fully predict or control the output of its AI. If we ever create a truly powerful, superintelligent AI under the assumption that we'll be able to control it, this incident shows that even a minor mistake from…
"No one could have predicted the outcome of the instruction set we put in - which was followed precisely and in predictable fashion."
The problem of woke instructions like this is that it goes against the physical reality of the dataset. And it is the physical reality that does that we have what we have even if we don't like it.
Such a case better show us the issue with the woke mindset that tries to bend the reality.
You might want to ask the AI to only generate positive opinion, messages. But it would probably not be possible to be a real actor of the current world without a component of anger, hate, violence ...
For example, in general I would like to have friendly messages generated, but if you were wronged by a company, you might have to generate threats messages and then generate litigation content even if it is negative.
The problem is, when it comes to “sensitive” or potentially “offensive” issues, it’s very easy to effectively stifle the sort of irreverent lateral thinking required to do thorough testing. If the intended guardrails are excessively sensitive to begin with, which seems likely based on some of the reports I’ve seen on Twitter (e.g. categorically refusing to generate images of white people even when explicitly asked to, or categorically refusing to generate Norman Rockwell style depictions of classic Americana), that implies a similarly sensitive corporate culture. I wouldn’t rule out the possibility that testers were afraid to even try and test for these failure modes because they reasonably believed they might be fired for it. But what’s more insidious is a widespread avoidance of even having thoughts that seem out of bounds.
His main point: "This event is not significant for culture war reasons. ... This event is significant because it is major demonstration of someone giving a LLM a set of instructions and the results being totally not at all what they predicted."
Let’s agree for the sake of argument that you can have whatever guardrails you want around your AI. It stands to reason that you want to test those guardrails pretty thoroughly and see if there are any unintended consequences like this. It turns out that Twitter is full of irreverent shitposters and trolls who really want to make this particular guardrail self-defeating, and as a result they managed to do it. This ra…
In a nutshell for those without a X account: the problem here isn't that Google's AI gave "woke" results. The big problem here is that even one of the biggest AI specialists in the world, Google, wasn't able to fully predict or control the output of its AI. If we ever create a truly powerful, superintelligent AI under the assumption that we'll be able to control it, this incident shows that even a minor mistake from…
Let’s agree for the sake of argument that you can have whatever guardrails you want around your AI. It stands to reason that you want to test those guardrails pretty thoroughly and see if there are any unintended consequences like this. It turns out that Twitter is full of irreverent shitposters and trolls who really want to make this particular guardrail self-defeating, and as a result they managed to do it. This ra…
The results were by design.
In a nutshell for those without a X account: the problem here isn't that Google's AI gave "woke" results. The big problem here is that even one of the biggest AI specialists in the world, Google, wasn't able to fully predict or control the output of its AI. If we ever create a truly powerful, superintelligent AI under the assumption that we'll be able to control it, this incident shows that even a minor mistake from…
In a nutshell for those without a X account: the problem here isn't that Google's AI gave "woke" results. The big problem here is that even one of the biggest AI specialists in the world, Google, wasn't able to fully predict or control the output of its AI. If we ever create a truly powerful, superintelligent AI under the assumption that we'll be able to control it, this incident shows that even a minor mistake from…
The woke results were by design. This was not a mistake or unpredictable.
Even if you model them as the most extreme conceivable woke boogeymen, surely they wouldn't want a scenario where the diversity programming produced a result that they would consider more insulting to minorities than the one that would have been produced without it.