Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Khan Academy integrates GPT-4 as every student’s customized tutor

openai.com

Post reply on HN
Print view View original

171–180 of 211 posts

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#171

Post by sebzim4500 »

davesque wrote: post #169
sebzim4500 wrote: post #162

Earlier quoted context omitted.

>Just because humans make mistakes (or even as many or more mistakes than machines) doesn't mean the nature or consequences of the mistakes are the same. True, but this shouldn't be hard to measure. It's not like we will go from these AIs will go from teaching no one to replacing all teachers overnight. Give a random sample of classes access to a GPT-n powered tutor, and see if they do better or worse over the next f…

> this shouldn't be hard to measure > see if they do better or worse over the next few years This doesn't strike me as entirely ethical. Also, it may be hard to gauge the long term effects of subtle misinformation generated by these models.

Surely there are more stupid experiments about teaching kids than this.

Give them all ipads

Give them all chromebooks

Take away their ipads

Make them all stay home and shut down the economy for 6 months

etc.

Especially since this one has a decent chance of working

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#172

Post by pnt12 »

navigate8310 wrote: post #40
jhp123 wrote: post #32

I've tutored people at times. A good tutor needs to understand the subject very well, so they can not only understand the right answer but also figure out why the student is coming to the wrong answer. I personally think that assigning GPT as a "tutor" is devaluing the real skill involved in tutoring and I doubt it will work out.

I would like to divert your attention to this recent post: https://openai.com/research/gpt-4 specifically on the topic of "Steerability: Socratic tutor" (Sample 1 of 3)

Very interesting, thanks for referencing it as I had missed it.

There have been occurrences of people asking chat gpt to ignore instructions on the initial prompt: have these been solved? It's not clear to me if the first prompt is given any extra weight. Or maybe during training of version 4 they have heavily penalized these sorts of attacks to make it more resilient.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#173

Post by mfer »

pixl97 wrote: post #168
mfer wrote: post #20

A lot of what GPT-4 can return is ideas based on assumptions and beliefs. Who chooses what of these to train the system? Those subtle ideas will then lead students who are mostly children.

And that is any different from the school books we currently use how?

For one, school book authors create books. GPt-4 is the tech industry. You shift who picks the views.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#174

Post by sebasvisser »

davesque wrote: post #141
thethimble wrote: post #134

Earlier quoted context omitted.

Human teachers make mistakes too - perhaps even at higher rates than GPT in some cases. Instead of isolating a single factor of hallucinations I think you have to also consider the cost and experience quality and make a more holistic judgement on whether these models are good or bad.

Yes, but human teachers can eventually come to understand why they made a mistake. And they probably are more able to communicate how confident they are in their answers. I think that's because human teachers have a mental model that they're working from. On the other hand, we have no idea if transformer models are working from anything like a "mental model." Just because humans make mistakes (or even as many or more…

Human teachers realising their mistakes and learning from it… how long ago was it that you were in an average school?

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#175

Post by worrycue »

tenpies wrote: post #170
worrycue wrote: post #67

Am I the only one somewhat alarmed that we are choosing to rely on AIs that are vulnerable to hallucinations so much? Personally I rather have a more limited but reliable tool than a more powerful but unreliable one.

Are the tolerances in education really that tight? How many terrible teachers are allowed to continue to teach after decades of disastrous results? How many ideologues with no interest in teaching, but every interest in indoctrinating young minds, are tolerated because the alternative is "no teacher" and the class wouldn't run? How many teachers who would fail state exams, teach, despite relying on answer sheets to b…

I feel the question is, should we be making this worse with unreliable AI.

Currently AI seem to have 2 weaknesses, it’s quite bad at reasoning and it hallucinates.

Yes, humans screw up reasoning too but at least they try. AI like ChatGPT seem to skip critical thinking altogether - there are examples of ChatGPT contradicting itself multiple times in a single conversation.

Then there are hallucinations. When people don’t know something, most just say they don’t know. AI just can’t seem to help itself but make up complete BS that it confidently try to pass off as facts.

P.S. Frankly I think the 2 might be related. AI can’t “sanity check” it’s own output.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#176

Post by CuriouslyC »

nostromo123 wrote: post #160
CuriouslyC wrote: post #47

Earlier quoted context omitted.

Learning is absolutely going to be required, we are just going to need to spend more time learning patterns and motifs rather than lots of facts. Learning facts and trivia was already devalued by everyone having a hyper-encyclopedia in their pockets, this will just extend that. Knowledge of patterns and motifs in domains of information will let you work together with the machines in a way that an untrained person wil…

"Learning facts and trivia was already devalued by everyone having a hyper-encyclopedia in their pockets, this will just extend that." I hope you don't end up having surgery done by a doctor who has to check a "hyper- encyclopedia" in his pocket because learning facts is supposedly obsolete...

As opposed to the doctor who has glassed with a HUD that is guiding him through the surgery, or a robot that the surgeon is guiding in VR?

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#177

Post by pixl97 »

mfer wrote: post #173
pixl97 wrote: post #168

Earlier quoted context omitted.

And that is any different from the school books we currently use how?

For one, school book authors create books. GPt-4 is the tech industry. You shift who picks the views.

>school book authors create books

Do you want to know how I know you have no idea how grade school textbooks are created in the US?

https://www.rangevoting.org/FeynTexts.html

This was 60 years ago and it's got worse since then.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#178

Post by pixl97 »

worrycue wrote: post #67

Am I the only one somewhat alarmed that we are choosing to rely on AIs that are vulnerable to hallucinations so much? Personally I rather have a more limited but reliable tool than a more powerful but unreliable one.

I mean that is but one thing to worry about, we've gone about nowhere with the alignment problem, and we're screaming ahead at full speed with making these things more powerful.

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#179

Post by missingdays »

Wata2 wrote: post #91
worrycue wrote: post #67

Am I the only one somewhat alarmed that we are choosing to rely on AIs that are vulnerable to hallucinations so much? Personally I rather have a more limited but reliable tool than a more powerful but unreliable one.

Firstly, the unreliability may not be permanent, and we may improve the AI accuracy in the future. Secondly, we need to figure out what works and what not, and we're in the middle of such phase. Finally, there is no need to be alarmed, even with hallucinations, the amount of advanced (and reliable) knowledge provided by the AI vastly counterbalances the small mistakes. The elitist mindset needs to die, let's give acc…

What walls are you talking about and how an AI assistant that you have to "donate" to get access to is going to help with these walls?

Re: Khan Academy integrates GPT-4 as every student’s customized tutor

#180

Post by squeaky-clean »

lemming wrote: post #137
frankfrankfrank wrote: post #127

Earlier quoted context omitted.

I frequently find myself in the middle of many things, one of them is that although I oppose the grotesque plunder of the public and citizens of countries by neo-aristocrats claiming to do one thing or another amidst blatant lies of social welfare, I also object to slavery and therefore cannot condone that everything should be free since people like being compensated for their work, and not by being indentured and fo…

Which is fine, but don't call it a donation.

My guess is that even though it's mandatory, it legally counts as a donation for tax deduction purposes.
Post reply on HN