Earlier quoted context omitted.
Human beings are currently capable of productively searching through the space of possible knowledge and experience in ways no current AI systems are. This is not to say AI will never do this, but I think it's fair to say there are things human beings are capable of doing today that AI is not, and it remains very much unclear whether AI will ever be able to achieve important milestones like being conscious in the sen…
> Human beings are currently capable of productively searching through the space of possible knowledge and experience in ways no current AI systems are. I would say the opposite: AI are very good at searching through information spaces, much better than we are. They're terrible at learning from experience, the points made in the article about that are I think valid, but they're wildly super-human at searching. > like…
We are likely talking past each other here. By "searching" I don't mean how inference is currently carried out by efficiently analyzing the context window using weights trained on large data sets fine tuned on specific goals.
I mean the process by which novel information is discovered, which is why many proponents of AI will concede that it's not currently capable of "doing science" or making novel discoveries.
> we don't know what that is, it's just what we do.
Not sure I understand, we have a pretty good understanding of what qualia actually is, even if it can be difficult or awkward to talk about conceptually. The gap between having a subjective experience and not having one is a large one, just ask anyone who's alive but under general anaesthesia that induces loss of consciousness. Qualia is simply what arises from the quality and character of having a subjective experience.