Live data from Hacker News

AI Homework

stratechery.com

101–110 of 296 posts

Re: AI Homework

#101
post #95

As easy solution to this is the just not give any credit for homework that goes toward a final grade. Have a number of in person closed book tests that are difficult enough to prove satisfactory understanding of the topic. Homework is just a mechanism for a teacher/professor to force a student to dig into and really understand a subject. If the student can use these AI tools to subvert that, then instead of wasting e…

sounds like law school

Re: AI Homework

#102
One of my subjects at highchool was technical drawing.

The teacher was a quite old man who was set on his ways. We would have to draw 3D pieces by hand, using our squares, bevels and compasses, and lining everything with an ink pencil afterwards, and he gave us a lot of homework to do, which he examined for imperfections.

I was incredibly bad a it. I would start a drawing, only to discover halfway through it that it didn't fit the sheet of paper I had and I had to change the perspective. My perpendiculars were never perfectly aligned. I would smear blots of ink with my tools and hands.

It was excruciating.

This is the point where I would usually say that I learned to enjoy the repetition and eventually came to appreciate it and be good at it. But that's not what happened.

Instead I started doing my homework using the computer, printing, and then tracing the points by hand. This resulted on cleaner-looking homework and took less time to do. What's surprising perhaps is that it enabled me to appreciate design more, now that I was no longer limited by the drawing technique, which was, I believe, my teacher's real interest (he was a painter outside of school. A very nice person, I didn't enjoy lying to him like that).

You might think that this would prevent me from performing well on exams, where a clean enough drawing (done by hand) was expected. The thing is: I could muster the effort to do a one-off drawing that was clean and precise, from time to time. Just not after every lesson. I actually got the maximum qualification on my province's technical drawing examination.

This is all to say: I agree with the Author. Once the tools are out there, trying to limit them is pointless. You must adapt your curriculum to the environment your pupils are in. If you don't, they will.

Re: AI Homework

#103
> despite the fact that the underlying model is the two-year old GPT-3.

This is incorrect, it's not a 2 year old model, it's the latest updated model they're calling GPT 3.5, which I believe has an order of magnitude higher number of parameters.

Also, the reason there wasn't an explosion of AI uses for OpenAI's products versus something like Stable Diffusion is that OpenAI costs money and isn't extensible, while SD is. Innovation comes from such extensibility, and in a way, this just shows how right Stallman was.

Re: AI Homework

#104
post #95

As easy solution to this is the just not give any credit for homework that goes toward a final grade. Have a number of in person closed book tests that are difficult enough to prove satisfactory understanding of the topic. Homework is just a mechanism for a teacher/professor to force a student to dig into and really understand a subject. If the student can use these AI tools to subvert that, then instead of wasting e…

That would pretty much guarantee nobody would do any homework ever again.

Homework isn't effective at making students "dig into and really understand a subject" - it's a method of externalizing school expenses onto parents, because teacher time and school funds are finite, and the time of parents and children is... not the school's problem. Making the final grade conditioned on homework performance is just about the only way to ensure kids do it (or are made to do it) at all.

Now, I'm not saying homework is entirely a bad idea - I'm complaining that it's being treated as an externality, making it almost unbounded. Teachers don't coordinate among themselves the amount of homework each of them assigns, so the only thing limiting the total amount of homework is a good chunk of the class being systematically exhausted by it, or (hopefully) parents making a fuss before things reach this level. But, the only reason the teachers can push so much homework on kids in the first place is that homework grades matter for the finals.

Re: AI Homework

#105

Nothing quite beats a low key oral exam. The trick is that they don't scale.

These days I give take home video exams. The students record themselves explaining their code for 5 minutes, which is about as long as it takes me to hand-grade a written exam. I can even play the video at 2x to cut the time in half. This scales at least to the size of my class (100 students on average, 3-4 hours isn't bad for grading an assignment).

I like this idea, but had a morbid thought, what if students try to bribe teachers in video? A lot of teachers I know intentionally keep their open doors during office hours. They don't want the student to get ideas.

One professor I know had a student drop a hundred on his desk and say something like "for our understanding" and then leave. So, it definitely happens. With video there are still ways that a student might make attempts to bribe a teacher, and it seems to be a vector of easier success because of how private the interaction is between the two individuals...

Re: AI Homework

#106
post #95

As easy solution to this is the just not give any credit for homework that goes toward a final grade. Have a number of in person closed book tests that are difficult enough to prove satisfactory understanding of the topic. Homework is just a mechanism for a teacher/professor to force a student to dig into and really understand a subject. If the student can use these AI tools to subvert that, then instead of wasting e…

I agree, and can we have a discussion in general about homework being included in the grade in general? It's purpose is to help students learn the material, which should be reflected on the test.

If the student can perform well on the test without that, then they shouldn't be forced to do it and penalized when they don't(which you can imagine happens often, as if the student understand the material well enough already the homework is just useless busywork.

If the student can't perform well on the test without that, they will be forced to do the homework. In this case, including homework as part of the grade might be detrimental because they can cheat/copy/us AI to complete homework and boost their grade enough to pass while not understanding the material well enough to pass the tests.

The counter-argument here(that I can think of) is that doing homework, even if - or especially if - it's just easy busywork for the student, prepares them for the future where such tasks will almost always be necessary to succeed. A lot of good learners end up not developing this skill/discipline because they aren't forced to work hard in school, which causes them to fail when faced with tasks/problems that require serious effort, and this would arguably make things more difficult for them. In my opinion this problem would be better addressed by funneling kids into classes that are appropriately challenging for them rather than forcing them to do busywork, but that's a much more difficult thing to do, and also learning to complete easy/"useless" busywork is a related but different skill than learning to focus on and complete challenging tasks

Re: AI Homework

#107
post #4

I finally went ahead and tried ChatGPT this morning (along with everyone else seemingly - it is now heavily rate-limited!) and I am truly blown away. I ask questions about various things (in my case, embedded systems development on the PineNote) and it gives the same quality of answers I would expect from a median coworker. Sure they're maybe not 100% correct, but most coworker answers aren't 100% correct either. The…

If you ask it about things which require deduction like Math, even simple Math questions like multiply binomials or solve a quadratic it gets it totally wrong, confidently, and even if you correct it, it often still gets it wrong. It’s not even close to something like Wolfram Alpha. I think we’re blown away more by its command of language and prose than by its reasoning ability. It’s fantastic at generation, but like…

Sure. But if you combine the understanding that this chatbot has with a Wolfram Alpha backend, you could build an even more amazing system. I'm sure someone is working on hooking up language models to math backends (anywhere from a simple calculator to Wolfram Alpha).

Re: AI Homework

#110
post #95

As easy solution to this is the just not give any credit for homework that goes toward a final grade. Have a number of in person closed book tests that are difficult enough to prove satisfactory understanding of the topic. Homework is just a mechanism for a teacher/professor to force a student to dig into and really understand a subject. If the student can use these AI tools to subvert that, then instead of wasting e…

That would pretty much guarantee nobody would do any homework ever again. Homework isn't effective at making students "dig into and really understand a subject" - it's a method of externalizing school expenses onto parents, because teacher time and school funds are finite, and the time of parents and children is... not the school's problem. Making the final grade conditioned on homework performance is just about the…

that's a good point, I just made a comment next to yours responding to the same original comment about whether homework should exist at all, and I think you're idea that it is a way to extend the "learning time" of students without requiring more time and resources from teachers is a good counter-point.

If you have the time to read my other comment, what would you think about the idea of only making homework mandatory for students who's quiz/test grades are below a certain level, say 70% for example

Post reply on HN