31–40 of 138 posts
For the DEFCON AI Village in August I talked about the implications of this sort of tech, and how that impacts how we release "exploit" code / think about "cognitive vulnerabilities": https://medium.com/@aviv/what-does-a-world-with-automated-so....
If you are doing work in this space, either in ML research or related security, you need to be thinking about implications (also see e.g. https://maliciousaireport.com).
While censoring the full data set seems in some way to support the rationale of the OpenAI charter, it also means that only state actors and very well-funded entities will be able to use the work to create models of the size necessary to do the impressive stuff in the write up. Based on the concerns, it would seem that restricting the capabilities only to state actors would have the opposite of the intended effect. W…
My argument: state actors might misuse this tech, but letting any script kiddie do whatever they want almost guarantees someone will misuse it.
Started a Google colab with the interactive text generation script. https://colab.research.google.com/drive/1da54684tFMjPbR5idbv...
(These results look fire btw)
Note: copied my comment from dupe thread
The generated example of the biologists discovering a unicorn herd is too convincing on its own. It's only because it's so outlandish that we get the sense it's fictional.
Started a Google colab with the interactive text generation script. https://colab.research.google.com/drive/1da54684tFMjPbR5idbv...
to be clear, this is the "politically innocuous" open sourced model. the results are not impressive.
This was only a matter of time. For the DEFCON AI Village in August I talked about the implications of this sort of tech, and how that impacts how we release "exploit" code / think about "cognitive vulnerabilities": https://medium.com/@aviv/what-does-a-world-with-automated-so... . If you are doing work in this space, either in ML research or related security, you need to be thinking about implications (also see e.g.…
I assume discriminative models will solve the problem for a while, but as with Generative adversarial networks, you will be able to train models that are harder to discriminate against. I posit we're in for a big societal change (maybe more a content crisis) sometime in the next 10 years. Pretty sure we won't be able to keep it from falling in bad hands.
While censoring the full data set seems in some way to support the rationale of the OpenAI charter, it also means that only state actors and very well-funded entities will be able to use the work to create models of the size necessary to do the impressive stuff in the write up. Based on the concerns, it would seem that restricting the capabilities only to state actors would have the opposite of the intended effect. W…
I would guess this reduces the risk. Why would you say it does the opposite? My argument: state actors might misuse this tech, but letting any script kiddie do whatever they want almost guarantees someone will misuse it.
Case-in-point:
Wannacry: https://en.wikipedia.org/wiki/WannaCry_ransomware_attack
NotPetya: https://en.wikipedia.org/wiki/Petya_(malware)#2017_cyberatta...
The rest of us will be force-fed with machine-generated garbage.