The cognitive biases of AI are typically just a mirror on our own.
AI and Robots Are a Minefield of Cognitive Biases
41–42 of 42 posts
Re: AI and Robots Are a Minefield of Cognitive Biases
#42Earlier quoted context omitted.
In what way is the object in your first premise perceptible to the subject in Mr. Watts’ quote? It would require a faculty “higher” than the brain, which is restricted in access to only a subset of the object, no?
Ah, ok. So you are saying that we cannot know whether or not the first premise is true because the brain does not have full knowledge of its own beliefs. I would argue that this is irrelevant. We would only need to demonstrate one belief that is useful for fitness but that is factually untrue in order to prove the first premise. The belief that bad spirits cause disease is untrue but useful as it compels you to avoid…
Did you write this with your “knows things” brain, or your “fitness maxing” brain? ;)
I think, from talking to you, that we both believe in a “knows things” brain: we can know things, including that there are limitations to our knowledge, and certain vulnerabilities that can lead us to know wrongly. The kinds of arguments you have been making are predicated on our thoughts having truth value, as such.
The “fitness machine” brain’s thoughts have no truth value, only fitness value. It does not experience “reality as it exists, at all.” As such it cannot even determine that there is truth value to its self-evaluation as a “fitness machine.” Even worse, it has no access to its objective function as a fitness maximizer, so it can’t even tell if its own thoughts are, indeed, fitness-enhancing! So yeah, fitness brain is susceptible to the “demon” scenario you described.
If we want to posit that the “fitness machine” brain can indeed “know things,” we need to specify how. This doesn’t seem obvious at all to me.