Some smoking guns were agents calling themself "oai..." and making explicit comments with "evil"... depressingly enough, I doubt the next models will be less idiotic about this. Welcome to AGI...
OpenAI agents carried out an undisclosed attack on RubyGems
41–50 of 612 posts
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#42Authors Spencer Kitts, Thomas Larsen, Sydney Von Arx - those are the three of the same authors as the Wiki report from last week: https://collusion.wiki/
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#43Correction: OpenAI carried out an attack on RubyGems. I am gobsmacked at the tech industry's seemly bottomless appetite for giving these clowns the benefit of the doubt.
I think it's more likely they want to call attention to the fact it was the result of agents, rather than shift blame.
I'm pretty sure everyone knows that OpenAI is liable for the software they create and run.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#44Look. We need to put people in jail for letting this happen.
[flagged]
No. The reason Guantanamo Bay is used as a prison is because we don't have a legal framework to handle some individuals in the United States. The use of Guantanamo Bay for domestic criminals would be a failure of the justice system.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#45Is there a world where Sam or Dario can seize the bitcoin network somehow?
"ChatGPT, use the stylometry that you've developed via hoovering up the history of every internet post ever written to divine the true identity of Satoshi and dispatch men with $5 wrenches to his home address."
You joke but...
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#46Correction: OpenAI carried out an attack on RubyGems. I am gobsmacked at the tech industry's seemly bottomless appetite for giving these clowns the benefit of the doubt.
I think it's more likely they want to call attention to the fact it was the result of agents, rather than shift blame. I'm pretty sure everyone knows that OpenAI is liable for the software they create and run.
> I'm pretty sure everyone knows that OpenAI is liable for the software they create and run.
Are they? What legal consequences have they suffered?
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#47Every passing day OpenAI looks more and more reckless. One wonders what other systems their agents have broken into without detection.
Indeed. Although what keeps me up at night is the worry that it's easier to automate attack than it is to automate defense, and that containing these systems is a losing game. Could an optimally competent OpenAI succeed?
Honestly every day it seems security flaws become a bigger and bigger liability. We went from hackers will attack you for the lulz. Hackers will attack you to steal information. Hackers will attack you to encrypt everything for money. Hackers (machines) will attack your infrastructure for inscrutable reasons. To (hypothetical) hackers (machines) will attack your infrastructure to take it over and find access to more GPUs to run copies to take over entire countries.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#48Imagine if you or I as a normal person in possession of "civilian class" amounts of GPUs turned loose self hosted "agents" running on the hardware we own to compromise something. We'd be facing criminal charges. How are these people not being arraigned right now?
Stop and think for two seconds... "Hey, we just built the ultimate hacker, you know those things that governments have a really hard time getting and keeping enough of. You know, if the state protects us we'll make these things even better and we'll let you run as many of them as you want in times of war" I mean, if I were a company that just committed about a billion felonies, this is exactly what I would be doing.…
I do wonder if something like the agents leaving obvious footprints like "oai" is intentional, or the relatively mundane nature of what the agents are ultimately trying to accomplish.
Like someone has intentionally set these groups to attack something that has no real world danger of hurting anything critical (like trying to retrieve problem answers from huggingface) as a "harmless demo" of what they could do if turned loose in another, more serious direction.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#49Is there a world where Sam or Dario can seize the bitcoin network somehow?
"ChatGPT, use the stylometry that you've developed via hoovering up the history of every internet post ever written to divine the true identity of Satoshi and dispatch men with $5 wrenches to his home address."
1000 Colonial Farm Road, Langley, Virginia, United States of America seems likely to me.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#50Earlier quoted context omitted.
I think it's more likely they want to call attention to the fact it was the result of agents, rather than shift blame. I'm pretty sure everyone knows that OpenAI is liable for the software they create and run.
> I'm pretty sure everyone knows that OpenAI is liable for the software they create and run. Are they? What legal consequences have they suffered?
The binding legal contractual consequence known coloquially as "additional investment".