11–20 of 90 posts
A nice allegory about strong AI.
If only chess were a nice allegory for life.
(After googling, it turned out to be a blog post: https://observer.com/2016/01/your-life-is-tetris-stop-playin...)
Why do we think AI will have motivations like a greedy human might? Why do we think AI will have motivations at all? Why do we think such AI is a pressing threat?
Why do we think AI will have motivations like a greedy human might? Why do we think AI will have motivations at all? Why do we think such AI is a pressing threat?
This is actually one of the failure modes described long ago. Paperclip maximizer. An AI that has agency, intelligence, and a goal . In the course of achieving its goal it completely neglects all other considerations. These unaccounted externalities are the danger.
Why do we think AI will have motivations like a greedy human might? Why do we think AI will have motivations at all? Why do we think such AI is a pressing threat?
I’m not afraid of the motivations of a hypothetical strong AI… I’m absolutely terrified of the motivations of those who can afford to employ weak AI.
Why do we think AI will have motivations like a greedy human might? Why do we think AI will have motivations at all? Why do we think such AI is a pressing threat?
Heck, even if you just give it some hard maths problem, the machine might think of ways to turn the entire solar system into a giant computer, using us for spare parts along the way. That requires a sufficiently accurate model of the universe of course, as well as ways to harness that model (say the AI starts by convincing humans to build robots and factories — which would be quite easy if it’s good at playing the stock market game).
Earlier quoted context omitted.
Because you can’t stop people, companies and/or countries from creating AI with those motivations.
I'm not worried about the AI, I'm worried about the people and companies that have it.
Earlier quoted context omitted.
This is actually one of the failure modes described long ago. Paperclip maximizer. An AI that has agency, intelligence, and a goal . In the course of achieving its goal it completely neglects all other considerations. These unaccounted externalities are the danger.
In addition to a hypothetical AI, it sounds like you are describing real companies here.
Why do we think AI will have motivations like a greedy human might? Why do we think AI will have motivations at all? Why do we think such AI is a pressing threat?
Many of these instrumental goals could put humans and human interests at risk.