For some reason this makes me think of corporate policies - how some people game them and how others except that the incentives are unattainable.
It’s pretty similar to quitting once all your equity has vested.
An AI wolf that preferred suicide over eating sheep
111–120 of 223 posts
Re: An AI wolf that preferred suicide over eating sheep
#112Earlier quoted context omitted.
How did you measure control over the world?
In an active inference approach you would have the agent minimise surprisal. Choose the action that is most likely to produce the outcome you predicted.
The approach I used was similar. The idea of maximising observed control of the world means you seek states where you can reach many other states, but _predictably_ so. This comes 'for free' when using Information Theory to model a channel.
Re: An AI wolf that preferred suicide over eating sheep
#113Wouldn't a higher penalty for bolder hits solve that problem, especially a high penalty for suicide? Would be more realistic because dying has higher cost than failing.
There are several incentive fixes: change the negative incentive to a factor that discounts the reward for catching a sheep, add a negative incentive to death, or a positive incentive to being alive at the end of the simulation. The failure here was they didn't think about what happens when the agent can't achieve a positive score, ie can't catch a sheep.
Re: An AI wolf that preferred suicide over eating sheep
#114The philosopher Hubert Dreyfus argued that computers, who have no body, no childhood and no cultural practice, could not acquire intelligence at all. https://www.nature.com/articles/s41599-020-0494-4 What he means is that computers, which can learn rules and use those rules to make predictions in certain domains, nevertheless cannot exercise general intelligence because they are not "in the world". This renders them…
This is why all AI today falls o to the narrow AI category. It just often omitted because it's true for all of them.
Re: An AI wolf that preferred suicide over eating sheep
#115Similar story of unexpected AI outcomes... As part of my PhD research, I created a simplified Pac-Man style game where the agent would simply try to stay alive as long as possible whilst being chased by the 3 ghosts. The agent was un-motivated and understood nothing about the goal, but was optimising for maximising its observable control over the world (avoiding death is a natural outcome of this). I spent sometime t…
Same story as one I shared 4 years ago. Seems to be the best tactic! https://news.ycombinator.com/item?id=14031932
Edit: don’t want to sound accusatory
Re: An AI wolf that preferred suicide over eating sheep
#116Reminds me of the old essay by 'Eliezer: "The Hidden Complexity of Wishes". https://www.lesswrong.com/posts/4ARaTpNX62uaL86j6/the-hidden... In it, there is a thought experiment of having an "Outcome Pump", a device that makes your wishes come true without violating laws of physics (not counting the unspecified internals of the device), by essentially running an optimization algorithm on possible futures. As the essay…
Related to the paperclip maximiser [1]:
> Suppose we have an AI whose only goal is to make as many paper clips as possible. The AI will realize quickly that it would be much better if there were no humans because humans might decide to switch it off. Because if humans do so, there would be fewer paper clips. Also, human bodies contain a lot of atoms that could be made into paper clips. The future that the AI would be trying to gear towards would be one in which there were a lot of paper clips but no humans.
[1] https://en.m.wikipedia.org/wiki/Instrumental_convergence
Re: An AI wolf that preferred suicide over eating sheep
#117Earlier quoted context omitted.
Exactly, from technical perspective it's a nothing story. It's interesting, though, how strong of a reaction general public had to this. The story must have strongly resonated with what some folks were already feeling. When you squint (pretend to understand the technology not at all) it's a tragic story. The situation of the wolf seems similar to the situation of some people. Chasing their careers in a highly structu…
From the article in contrast to what you said; > Perhaps the true lesson to be learnt here isn’t about helplessness and giving up. It’s about getting up, trying again and again, and staying with the story till the end. I find the possibility of contrasting interpretations absurd. The problem with using any dead matter for our meaning making needs is it is ultimately a self-referential justification for how we think w…
Any programmer would have seen the issue and made the change about rewarding suicide.
The ONLY reason this was written was because the researches hired a programmer to make a specific thing, then is was too expensive for them to make more changes so they published the mistake.
Re: An AI wolf that preferred suicide over eating sheep
#118Earlier quoted context omitted.
Exactly, from technical perspective it's a nothing story. It's interesting, though, how strong of a reaction general public had to this. The story must have strongly resonated with what some folks were already feeling. When you squint (pretend to understand the technology not at all) it's a tragic story. The situation of the wolf seems similar to the situation of some people. Chasing their careers in a highly structu…
> The story must have strongly resonated with what some folks were already feeling. Yes, because we don't see things as they are, we see them as we are.
At a Grateful Dead show in Oakland this geezer said to me:
Your perception IS your reality man!
Re: An AI wolf that preferred suicide over eating sheep
#119Earlier quoted context omitted.
Exactly, from technical perspective it's a nothing story. It's interesting, though, how strong of a reaction general public had to this. The story must have strongly resonated with what some folks were already feeling. When you squint (pretend to understand the technology not at all) it's a tragic story. The situation of the wolf seems similar to the situation of some people. Chasing their careers in a highly structu…
Shrug. Another way to frame this is a poker bot learned to fold when given a bad hand, and they only gave it the same bad hand. Yes, yes, woe is the individual in modern capitalist society but the only reason people are reacting to this are that they don't understand it and they've been told it's something much more emotionally impactful than it actually is.
>but the only reason people are reacting to this are that they don't understand it
I think it's much more likely that they're reacting like this because they see their own plight in the wolf. It doesn't matter why the wolf killed itself, it became a meme that allowed many Chinese to reflect together on a common plight.
Re: An AI wolf that preferred suicide over eating sheep
#120The philosopher Hubert Dreyfus argued that computers, who have no body, no childhood and no cultural practice, could not acquire intelligence at all. https://www.nature.com/articles/s41599-020-0494-4 What he means is that computers, which can learn rules and use those rules to make predictions in certain domains, nevertheless cannot exercise general intelligence because they are not "in the world". This renders them…
Imagine being a dualist in the 21st century.