Earlier quoted context omitted.
A would be assassin would obviously ask the algorithm to suggest a low risk and cost way of assassinating.
Except the reason why we dont all just killed each other yet have nothing to do with risk or cost of killing someone. And everything LLM can come up with will be exactly the same information you can find in any fiction detective book or TV series about crime. Yeah very very dumb criminal can certainly benefit from it, but he can as well go on 4chan and ask about assassination there. Or on some detective book discussi…
As Nathan states:
>And further, I argued that the Red Team project that I participated in did not suggest that they were on-track to achieve the level of control needed
>Without safety advances, I warned that the next generation of models might very well be too dangerous to release
Seems like each generation of models is getting more capable of thinking, beyond just regurgitating.