Earlier quoted context omitted.
It's funny that your explanation by analogy of death rests on the assumption the machines already understand how themselves work. There's really no reason why that should be case.
My definition of AI was based on human-like intelligence. I see your point that AI won't necessarily have human-like intelligence but could have something completely different, something that my puny human brain can't even comprehend. Then again, if an AI system can't understand how itself works, is it really intelligent? I don't know the answer to any of these questions. I'm just asking them in effort to help myself…
> Then again, if an AI system can't understand how itself works, is it really intelligent?
This question is particularly interesting as it can be applied to us as well.