> Applying this to education, I think that education needs to pivot explicitly to "solving problems" and not education for educations sake. e.g .The student needs to be engaged with a problem and reaches for AI as a tool to solve it and, as a result, up level their understanding.
It seems you are thinking of project-based learning. That is a great way to learn, but it only works when you have a certain level of baseline knowledge within the "zone of proximal development" to what the task requires. And even then, it does not replace other kinds of learning for developing expertise.
Think of asking a 5th grader to implement the FFT within a programming langauge of their choice. They wouldn't understand the problem, wouldn't know where to begin, and would probably learn very little. But they could still ask Claude or ChatGPT for an answer and there's a good chance it would be pretty close.
For a curious and motivated student, AI is an amplifier---similar to how you were using Claude. But most students just want to finish the task, in which case the more powerful the AI, the less the student needs to know to get a result. These students are not using the AI as a tutor or to fill in gaps in their knowledge. They are just copy-pasting the assignment into the prompt and pasting the output as the answer. That is not learning, and it can be done with projects too.
> If a huge mechanism for assessing folks in education is "write an essay on this" and the teacher then "grades the essay output by the student," that's almost the perfect task where AI can do both ends. Which is pretty much a sign that assessments such as this have low educational impact.
Not at all. It's a sign that AI can do the task.