Physicist proposes new way to think about intelligence

Whether or not you find this science rigorous, it is the kind of thing that leads to a "wow! my mind is blown" a-la so many smokey college dorm room nights.

Similar to the anthropic principle, these concepts are cool but hard to use.

Nevertheless I do like the way this one gives us a new way at justifying the value of 'interesting' stuff that we might be otherwise interested in discarding.

For example: the impulse on HN to discard this research... whether or not it's valid, it is certainly an interesting example of the point of the research itself. If this stuff has legs, it'll have legs. Mind blown? Bleh maybe for a second right?

I do agree with your statement that intelligence is difficult to describe. And for the record I never claimed the rational agent approach will achieve "true machine intelligence". Frankly, I don't even know what "true" machine intelligence is or would be. What I am very interested in however is how to create an AI that is capable of fooling a person into thinking it's intelligent, in other words an AI that can pass the Turing test. For that purpose I find the concept of a rational agent to be very helpful, in that it provides a solid foundation to work from.

I'm also not worried about Godel's theorem at all. The statements that are undecidable are very obscure and basically never come into play in human decision making. I think Godel's result has very little practical application, if it has any at all; I certainly don't think it's relevant for AI. I agree that choosing a logical framework to work in presents many problems, but I don't agree that you have to disprove Godel's theorem to create an AI that can think outside the box.

I would also add Max Delbruck to your list of turn of the last century physicists cum molecular biologists and the physicist members of the RNA tie club: http://en.wikipedia.org/wiki/RNA_Tie_Club.

I also have a question for the GP. What exactly makes a physicist so? I have "merely" a masters degree in physics, and although I consider myself to be a theoretical biologist, I am often called a physicist by my collaborators (some of whom are physicists themselves). What about a degree actually matters in this descriptive title?

Of course any simulation is implemented in some formal system, but that's not what I'm saying. I'm saying the inherent problem with a rational agent is that they maximize utility within a formal system -- that is what they do, that is their entire purpose. Once we start talking about rational agents that can "think outside the box", or think beyond the formal system in which they're defined, we're no longer talking about rational agents.

I agree with your belief that we may some day build AIs that think outside the box, I just don't see how it can be a rational agent. I think it will be much closer to a neural network, or probabilistic reasoning model, or some extremely "organic" or "fluid" device from which intelligent behavior organically emerges. Because if intelligence emerges from a strictly formalized framework, then Godel's theorems prove some very crippling limitations on what's possible within that fixed framework.

FYI there is definitely a connection between Godel's theorem and intelligence, though it may not be immediately obvious. I would highly recommend this as fun learning material: http://ocw.mit.edu/high-school/courses/godel-escher-bach/