What were the primary reasons that made students who used ChatGPT do poorly on math assessments, even though they had worked correctly through a greater number of practice problems?
Kids who use ChatGPT as a study assistant do worse on tests
11–20 of 168 posts
Re: Kids who use ChatGPT as a study assistant do worse on tests
#12why is this surprising. all such tools hamper learning. if you want to learn, read books, read and write. don't use a spellchecker for ur language exam. no calculator for calculus. pen and paper. how is this going backwards :(
As cool as AI is, the only thing it’s going to do is increase inequality.
I bet all the wealthy and middle class parents with STEM background will get tutoring for their kids in the “old ways” knowing full well that the people who aren’t reliant on AI and can spot mistakes in output will now have a huge advantage in the workforce.
Re: Kids who use ChatGPT as a study assistant do worse on tests
#13why is this surprising. all such tools hamper learning. if you want to learn, read books, read and write. don't use a spellchecker for ur language exam. no calculator for calculus. pen and paper. how is this going backwards :(
Agreed. I dont want kids to use this until they are much older... it's a crutch. They are not applying critical thinking skills when using a LLM. The value is when children try->fail->try->fail->try->succeed. It builds up problem-solve abilities.
Re: Kids who use ChatGPT as a study assistant do worse on tests
#14Re: Kids who use ChatGPT as a study assistant do worse on tests
#15Did nobody read the article? It says right there that the students who used chatgpt right, as a tutor, did much better than their peers.
If your human tutors just give you the answers when you ask for them, how do you think it'll ho?
Re: Kids who use ChatGPT as a study assistant do worse on tests
#16I have wondered if future generations will struggling with critical thinking / problem solving - without the aided technology assistance.
Re: Kids who use ChatGPT as a study assistant do worse on tests
#17Gasp
Re: Kids who use ChatGPT as a study assistant do worse on tests
#18The title could be worded better. Kids using "base" GPT4 performed poorly but the ones with access to a finely-tuned "tutor" GPT4 did okay. The study was purposefully done in a domain the current SoTA LLMs struggle in (Math).
From the (draft!) paper's abstract:
A key remaining question is how generative AI affects learning, namely, how humans acquire new skills as they perform tasks. This kind of skill learning is critical to long-term productivity gains, especially in domains where generative AI is fallible and human experts must check its outputs.
..
Consistent with prior work, our results show that access to GPT-4 significantly improves performance (48% improvement for GPT Base and 127% for GPT Tutor).
However, we additionally find that when access is subsequently taken away, students actually perform worse than those who never had access (17% reduction for GPT Base). That is, access to GPT-4 can harm educational outcomes.
These negative learning effects are largely mitigated by the safeguards included in GPT Tutor.
Re: Kids who use ChatGPT as a study assistant do worse on tests
#19why is this surprising. all such tools hamper learning. if you want to learn, read books, read and write. don't use a spellchecker for ur language exam. no calculator for calculus. pen and paper. how is this going backwards :(
I can report that I have learned more about bash scripting in the past couple of years using ChatGPT to write all manner of scripts, than I did in the previous 20 years of copying and pasting things off StackOverflow.
Re: Kids who use ChatGPT as a study assistant do worse on tests
#20I learned the hard way: no pain, no gain.