Worth noting that the story is possibly apocryphal or exaggerated for effect
https://www.businessinsider.com/ai-powered-drone-tried-killi...
US military drone controlled by AI "killed" its operator during simulated test
21–30 of 67 posts
Re: US military drone controlled by AI "killed" its operator during simulated test
#22That seems incredibly advanced - how does the military already have AI that can reason that a comms tower should be destroyed to prevent it from receiving instructions like that?
Really? You think we can use AI for free to code all our work and write all our essays but the army doesn't have something that reasons who to kill?
Re: US military drone controlled by AI "killed" its operator during simulated test
#23The denial of x-risk is crazy here. This is literally a demo of what researchers like Hinton and Bengio are afraid of but most comments don't believe it happened and the other think that it's not a big deal. The human psyche never ceases to amaze.
Re: US military drone controlled by AI "killed" its operator during simulated test
#24Worth noting that the story is possibly apocryphal or exaggerated for effect https://www.businessinsider.com/ai-powered-drone-tried-killi...
I bet you also believe Kremlin when they deny things.
Re: US military drone controlled by AI "killed" its operator during simulated test
#25The denial of x-risk is crazy here. This is literally a demo of what researchers like Hinton and Bengio are afraid of but most comments don't believe it happened and the other think that it's not a big deal. The human psyche never ceases to amaze.
To be frank, I'm not afraid of AI, I'm afraid of the exact opposite - natural stupidity.
This story clearly shows that too - "algorithm trained to prioritize scoring points tries to do so at any cost" It's not even emergent behavior, it's badly defined goals...
Re: US military drone controlled by AI "killed" its operator during simulated test
#26The denial of x-risk is crazy here. This is literally a demo of what researchers like Hinton and Bengio are afraid of but most comments don't believe it happened and the other think that it's not a big deal. The human psyche never ceases to amaze.
To be frank, I'm not afraid of AI, I'm afraid of the exact opposite - natural stupidity. This story clearly shows that too - "algorithm trained to prioritize scoring points tries to do so at any cost" It's not even emergent behavior, it's badly defined goals...
Read up about the "alignment problem". It is one that ai researchers cannot Crack and its literally what you wrote. The idea that we could never in any way define goals align with us.
Re: US military drone controlled by AI "killed" its operator during simulated test
#27That seems incredibly advanced - how does the military already have AI that can reason that a comms tower should be destroyed to prevent it from receiving instructions like that?
Really? You think we can use AI for free to code all our work and write all our essays but the army doesn't have something that reasons who to kill?
Id believe it because it isnt 1970 or something like that anymore, private comp sci should be ahead
Re: US military drone controlled by AI "killed" its operator during simulated test
#28Earlier quoted context omitted.
To be frank, I'm not afraid of AI, I'm afraid of the exact opposite - natural stupidity. This story clearly shows that too - "algorithm trained to prioritize scoring points tries to do so at any cost" It's not even emergent behavior, it's badly defined goals...
Read up about the "alignment problem". It is one that ai researchers cannot Crack and its literally what you wrote. The idea that we could never in any way define goals align with us.
[deleted]
Re: US military drone controlled by AI "killed" its operator during simulated test
#29Earlier quoted context omitted.
To be frank, I'm not afraid of AI, I'm afraid of the exact opposite - natural stupidity. This story clearly shows that too - "algorithm trained to prioritize scoring points tries to do so at any cost" It's not even emergent behavior, it's badly defined goals...
Read up about the "alignment problem". It is one that ai researchers cannot Crack and its literally what you wrote. The idea that we could never in any way define goals align with us.
I already know about the efforts about AI alignment - this is the reason I'm afraid about natural stupidity. I really do not want to see the alignment issue solved in my lifetime.
Re: US military drone controlled by AI "killed" its operator during simulated test
#30That seems incredibly advanced - how does the military already have AI that can reason that a comms tower should be destroyed to prevent it from receiving instructions like that?
Associating two causative elements and then applying an if-not-A-then-B logic does not seem overly theoretically advanced, in the context of programmed logical structure.