Earlier quoted context omitted.
Have you tried this with AI with a topic you are well versed in? I am very optimistic AIs will help people feel they have some sort of understanding but far less optimistic they’ll actually help build it. They’ll try to coerce any of your (or the model’s) mistakes into the correct answer out of politeness, and when you make a mistake it has zero model of the model you used to produce such a mistake, so it has no idea…
It sounds like you are doing something different than what I am suggesting. I am not quizzing the AI looking to determine how well the AI knows the subject. I am using the AI as if it doesn't know the subject at all. I try to explain a subject to the AI as if I am trying to teach a friend who has no knowledge on the subject. Then I am judging how well I can communicate the idea. In many cases as soon as I try to expl…
You're correct that it's an exercise in introspection, rather than relying on the AI's own knowledge. It was clear to me when trying to write explanations to its questions where my understanding was starting to get fuzzy and hand wavy.
A nice bonus was to get it produce a scorecard of correct, nearly correct and incorrect explanations. I could see these as a good jumping off point for me to do more learning/research. Though I suspect the AI would be less accurate at this in a more niche topic than I chose (refrigeration).