Live data from Hacker News

AI boosted homework scores, then exam scores dropped: study

economist.com

141–150 of 409 posts

Re: AI boosted homework scores, then exam scores dropped: study

#141
post #29
post #18

abolish homework

This is the answer. Many (all?) European schools don’t give homework (this is partly because of the way the grad programs work). It’s on the students to study in order to pass the (difficult) exams.

I don't think this is true, and frankly, I don't care what they do in Europe.

Re: AI boosted homework scores, then exam scores dropped: study

#142

The article does not relate AI usage for homework to exam score drops. It tries to link them together with no obvious cause and effect. The score could have dropped due to worse environment at schools or kids who were stuck at home studying online and now in physical locations could not adapt fast enough (meaning, possibly just temporary drops). We do not yet have enough metrics gathered yet. This type of article bas…

They left 20% of the 87,000 students as a control group. Is that not enough to allow for differences in environment, etc?

Re: AI boosted homework scores, then exam scores dropped: study

#143
post #7

The kids who used AI and studied for a similar amount of time as the non-AI high performers apparently had similar (slightly higher) performance. The kids who used AI and did poorly used the AI to do the homework for them (this is what the article says). I believe AI is basically an amplifier of bad and good. I’m cynical about the world and assume it will be used more for bad than good, but I don’t doubt some of the…

This is my thoughts as well! It makes smarter people smarter and dumb people dumber!

It helps smart people be barely more effective and helps dumb (more importantly, people who do not value effort, people who are lazy, people who are self absorbed) people shit out endless streams of worthless tokens that can swamp out everything.

Raising the noise floor like this only makes it that much harder to find "Smart" people, which we were already doing terrible at.

I use Claude every single day, but this is such a bad tradeoff. Maybe it will help me standup a quick fix when that is needed. Maybe it can help me dig through documentation to find relevant bits and figure out the unstated assumptions underlying it. Maybe it helps me generate test cases.

Meanwhile, my day to day life is now noise. All social media is noise. All content is noise. Slop pours onto me from all directions. Writing more test cases isn't helping me.

Am I smart? Am I dumb? I don't care, right now I'm deafened

Re: AI boosted homework scores, then exam scores dropped: study

#144
post #18

abolish homework

I got graded homework even in a few college courses and thought it was dumb, but then I realized it's always in the low-tier classes where they can't trust the students to study on their own. Those who skip homework hurt themselves by doing poorly on exams, but that's not enough to stop them. This ruins the curve in ways the instructor can't really fix unless they're prepared to fail half the class, which they aren't.

Re: AI boosted homework scores, then exam scores dropped: study

#145
post #7

The kids who used AI and studied for a similar amount of time as the non-AI high performers apparently had similar (slightly higher) performance. The kids who used AI and did poorly used the AI to do the homework for them (this is what the article says). I believe AI is basically an amplifier of bad and good. I’m cynical about the world and assume it will be used more for bad than good, but I don’t doubt some of the…

This is my thoughts as well! It makes smarter people smarter and dumb people dumber!

Most importantly, it makes investors think dumb people are smart.

Re: AI boosted homework scores, then exam scores dropped: study

#146
post #69

Earlier quoted context omitted.

Around here kids get homework in kindergarten . It's absurd.

Errr, what does it contain then? :-D This sounds really strange, never heard of. BTW / Offtopic: I have read some weeks ago, today if you are hosting a party for your kids birthday, parents are preparing "give away bags" for handing over when leaving the party

Yeah goodie bags are totally a thing.

Really well thought out goodie bags are a treat, they follow the theme of the party and they have memorable (even if low priced) gifts.

Most goodie bags are filled with disposable toys that break after a few minutes of play.

Re: AI boosted homework scores, then exam scores dropped: study

#147
post #7

The kids who used AI and studied for a similar amount of time as the non-AI high performers apparently had similar (slightly higher) performance. The kids who used AI and did poorly used the AI to do the homework for them (this is what the article says). I believe AI is basically an amplifier of bad and good. I’m cynical about the world and assume it will be used more for bad than good, but I don’t doubt some of the…

You aren’t being cynical, you’re arguing with disingenuous entities with money on the line. We already know it’s used primarily for the negative case. Everyone who ever intended High School or College knows this.

Re: AI boosted homework scores, then exam scores dropped: study

#148

For some of the classes my kids were in, the lessons and homework time were reversed. Learning the material (using the text book and videos) was what they had to do at night and class time was spent working through problems or applying the material in some way.

I think for my ADHD child-self, this would have been a huge improvement. I didn’t need help learning, I needed help doing homework.

Re: AI boosted homework scores, then exam scores dropped: study

#149
post #7

The kids who used AI and studied for a similar amount of time as the non-AI high performers apparently had similar (slightly higher) performance. The kids who used AI and did poorly used the AI to do the homework for them (this is what the article says). I believe AI is basically an amplifier of bad and good. I’m cynical about the world and assume it will be used more for bad than good, but I don’t doubt some of the…

The scary thing is that 81% of AI users in this study were determined to be "outsourcing" their homework to the LLMs - and the rate increases the more exposure they had to LLMs.

The "slightly higher" performance is based on statistically insignificant samples (between 4 and 20 students, depending on the context, out of the total population of 26,000): https://bsky.app/profile/benjaminjriley.bsky.social/post/3mt...

Post reply on HN