Reading this felt like darkness.
Disrupting malicious uses of AI by state-affiliated threat actors
11–20 of 94 posts
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#12> two China-affiliated threat actors known as Charcoal Typhoon and Salmon Typhoon; the Iran-affiliated threat actor known as Crimson Sandstorm; the North Korea-affiliated actor known as Emerald Sleet; and the Russia-affiliated actor known as Forest Blizzard.
I wonder who came up with those. The pattern is similar to the UK's https://en.wikipedia.org/wiki/Rainbow_Code , which makes me suspect that the threat actor attribution comes from US intelligence. With whom OpenAI are almost certainly cooperating.
Edit: Forest Blizzard == GRU, apparently. https://research.splunk.com/stories/forest_blizzard/
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#13Reading this felt like darkness.
? In what way?
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#14There seems to be little if any concern from OpenAI about using AI trained on mass surveillance data to generate lists of individuals to assassinate... does that not count as a 'state-affiliated threat'?
https://www.theguardian.com/world/2023/dec/01/the-gospel-how...
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#15Fuck openai, I'm a security researcher and if you dare ask it about anything Windows related it tells you to screw off. Linux? Fine. But ask about some undocumented Windows behavior and it says it can't. Ask it about patchguard internals as a reference? Tells you it can't assist. Absolutely crazy, I can understand asking it to write straight up malware, oh wait, it does that no issue! Lord help you if you want to use…
Agreed. Open AI defo need to tune their models so that it can provide enough information but not too much info which can be malicious. Currently, anything remotely close is flagged as malicious.
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#16Looking over the specifics, the striking thing about this to me is that it seems like these supposedly-sophisticated covert operatives are just going to ChatGPT (or similar) and basically asking "how do I make good malware?"
[flagged]
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#17If this is the case, there must be a serious competency crisis in foreign intelligence agencies. It’s trivial to run your own local model.
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#18If this is the case, there must be a serious competency crisis in foreign intelligence agencies. It’s trivial to run your own local model.
> It’s trivial to run your own local model
With what GPUs?
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#19[dead]
Re: Disrupting malicious uses of AI by state-affiliated threat actors
#20> two China-affiliated threat actors known as Charcoal Typhoon and Salmon Typhoon; the Iran-affiliated threat actor known as Crimson Sandstorm; the North Korea-affiliated actor known as Emerald Sleet; and the Russia-affiliated actor known as Forest Blizzard. I wonder who came up with those. The pattern is similar to the UK's https://en.wikipedia.org/wiki/Rainbow_Code , which makes me suspect that the threat actor att…
OpenAI said this work was done in conjunction with Microsoft’s long established threat intel center, these are almost certainly the code names Microsoft security intel teams have assigned to these actors. Threat actor naming is generally a mess and every company has a different naming scheme for the same cluster of indicators/ttps