Live data from Hacker News

Khan Academy integrates GPT-4 as every student’s customized tutor

openai.com

101–110 of 211 posts

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#102

Am I the only one somewhat alarmed that we are choosing to rely on AIs that are vulnerable to hallucinations so much? Personally I rather have a more limited but reliable tool than a more powerful but unreliable one.

Chatgpt is already more accurate than a lot of my high school teachers.

My thoughts exactly. What is the baseline here? Teachers already give biased and/or inaccurate information at a rate much higher than I have seen in ChatGPT.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#103

I wonder if this kind of intelligent tutoring could be the answer to Bloom's Two Sigma Problem. The limiting factor with that problem was that not everyone can afford a personal tutor. Having an AI tutor that can breeze through the SAT seems like it should give every student a major boost.

Circa late 2015, early 2016, my cofounder and I spent ~6 month attempting to build exactly this.

Our hypothesis was that students self studying for the SAT used books (eg Kaplan) but the solutions in the back were poor in explaining how they arrived to the solution because they usually just cut to the chase rather than explaining the approach & helping you arrive to the solution.

So we took each practice SAT math question and wrote out a solution spread over four swipeable pages. Our hope was that if you saw the first or second page, you'd arrive at the solution without having to see the answer, thus increasing your chance to solve it on your own next time.

We spent over 100 hours tutoring kids and had them use our MVP to mild success. The obvious next step was to automate the solutions rather than hand write it ourselves - like GPT-4 has done here.

As someone who has logged over 2000 hours teaching, there's a lot of soft nuances and tactics to tutoring. Also, motivation is a big thing a good tutor brings. I don't see this solution as quite there yet but getting close.

Very optimistic here.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#105
post #95
post #32

I've tutored people at times. A good tutor needs to understand the subject very well, so they can not only understand the right answer but also figure out why the student is coming to the wrong answer. I personally think that assigning GPT as a "tutor" is devaluing the real skill involved in tutoring and I doubt it will work out.

In my brief asking ChatGPT question and to rephrase/clarify, it seems at least as good as the average tutor/teacher/TA which for me has been marginally better than warm body rephrasing the theories and working through textbook problems in front of you. And in time, much better. To the point of raising the standard of education for all of humanity with access to the internet. I'd count on it "working out".

I'm 42 and still don't always like asking questions for fear of looking stupid if I ask one the wrong way. chatgpt has none of that because it's just an ai and won't judge me or make my imposter syndrome worse.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#107

Earlier quoted context omitted.

Khan Academy's integration of GPT-4 already steers students towards particular modes of thought. According to the article, they want "to get students thinking deeply about the content that they’re learning" and in the examples, Khanmigo prompts students to recall information from the lesson rather than directly explaining how to solve the problem. I think what Khan Academy has done here is desirable, but just as Step…

> Khanmigo is enforcing Khan Academy's values Every teacher does that, sometimes intentionally and sometimes not.

But individual teachers don't scale to planet-size. Or at least they didn't used to.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#108
post #32

I've tutored people at times. A good tutor needs to understand the subject very well, so they can not only understand the right answer but also figure out why the student is coming to the wrong answer. I personally think that assigning GPT as a "tutor" is devaluing the real skill involved in tutoring and I doubt it will work out.

My daughter does children's martial arts. Often in the dojo there's an atmosphere where the yellow belts are helping the white belts, the red belts are periodically chiming in, and the black belt adult instructor is free to float around the room supervising everything, giving individual attention where it's most effective, but leaving the lower ranks to take care of the lessons they're capable of giving.

In the same way, AI will be able to make an expert human tutor 100x more effective by escalating the tricky cases but learning how to handle the ones that come up over and over.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#109

Earlier quoted context omitted.

Do you know if/how someone can get involved with this at the research phase? I have a daughter who will be entering 1st grade next year and I'd be interested in having her try this out if there was a way of signing up.

The sign-up page to join our waitlist is here: https://www.khanacademy.org/khan-labs But we aren't planning to allow folks to enroll / allow Khanmigo for folks with children under 13 at this time as part of our research phase.

Or anyone outside the US :(

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#110

I wonder if the students can direct the AI to give them questions similar to what would show up in the tests. Do the teachers use the same AI as the students?

I don't think tests will work at all like that much longer; they'll be more like oral exams, where you have a back-and-forth conversation with an AI that probes the breadth and depth of your knowledge with sufficient variability as to detect overfitting (i.e., memorizing the answers to a few previous exams).
Post reply on HN