Earlier quoted context omitted.
> I'd argue that this is an adjustment period that society has to go through. I used to think like this until social media proved there are some tech innovations we just can’t adjust to. 10 years ago you would’ve never caught me supporting any sort of age based social media ban. Now? I don’t think it goes far enough. Fake news ( actual fake news) and misinformation has only gotten worse with it as well. It’s so destr…
The human is designed to interact with small groups, to understand several smaller groups, and perhaps to imagine a big group of smaller groups. In a literal sense, let's say 100 people per group. At that level the human can actually know and interact with them still. In a city of 100.000 it's still managable to feel you are related and involved to this group-of-groups. In a city of a million, you'll revert to only y…
Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
111–120 of 828 posts
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#112I have some sympathy for these kids. If LLMs were around when I was a student, I would've also used them to "speed up" my homework assignments then proceed to fail all my tests. Now I work mostly with PhDs who were at the top of every academic environment they've ever been in. And yet I can see their thinking skills rapidly declining as well; many of them can no longer brainstorm, code, think deeply, or write without…
But this doesn't seem to make sense when someone comes to a topic with an LLM in-hand. They need to know high-level techniques, architecture, best practice, etc. As they pursue the topic they start to get down into the details, although probably never learn to do it fully independently.
I quite like this view because it paints a somewhat optimistic way forward from where we are now.
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#113Earlier quoted context omitted.
They're incredibly more productive. LLMs are amplifiers, so where they'd have branched and tried out N things, they can easily try 5N pathways of RnD. LLMs are extending the frontiers of science fast -- math -> phy -> chem -> bio in that order.
To me it is crazy that you are being downvoted. My experience in academia was that an incredible amount of time was devoted to data cleansing analysis, coding, etc., which were completely non-core to the actual underlying academic pursuit.
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#114I have some sympathy for these kids. If LLMs were around when I was a student, I would've also used them to "speed up" my homework assignments then proceed to fail all my tests. Now I work mostly with PhDs who were at the top of every academic environment they've ever been in. And yet I can see their thinking skills rapidly declining as well; many of them can no longer brainstorm, code, think deeply, or write without…
With writing:
Things like brainstorming a plot line for a book with a custom GPT or Claude project that has all of my prior books in its knowledge? Works great.
Things like asking it to write a paragraph or chapter for me - I can rapidly feel my own writing skill, motivation, vocabulary, and ability to grasp/remember the resulting plotlines deteriorating. I don't use it for that anymore.
With studying:
I've been taking a couple of evening uni courses and the thing I found so great is that I've been forcing myself to think through the problems, and take my own notes in every lecture. I may then still get ChatGPT to help explain and reason through some of the concepts with me. And I have it review and 'grade' my assignments. But I refuse to ask it to start drafting answers.
With programming:
This one is tougher. When I am not very personally invested in a problem or codebase it becomes too easy to offload more parts to Claude, and when the company encourages 'vibing' to speed up velocity and you're reviewing and writing a higher influx of lower quality PRs, investment goes down. I still sometimes catch myself committing solutions I only _mostly_ grasp and the rest is hand-waving. A big part of it is a work culture thing.
For my own projects I make sure to understand and have a back-and-forth with the planning agent for each task, or write the first plan myself to go off of. When it comes to producing the code, I have to admit it is much easier to properly review parts of the codebase I am extra interested and knowledgeable in (backend in my case). The frontend I'm less well versed in and also admittedly less interested in, so I do sometimes fall into the trap of "Ehh it works, just commit it" with the goal of doing a thorough quality pass before actual release.
With all of the above, I can feel my ability to think, plan, reason, focus (and my vocabulary) suffer if I go over the line too much into agent offloading. For me keeping that balance is as much about maintaining my own long-term brain health as it is about producing good output. I imagine younger people growing up with AI today won't even know what that more capable (in my opinion) brain state feels like - to them, the AI-using brain will be the norm.
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#115I have some sympathy for these kids. If LLMs were around when I was a student, I would've also used them to "speed up" my homework assignments then proceed to fail all my tests. Now I work mostly with PhDs who were at the top of every academic environment they've ever been in. And yet I can see their thinking skills rapidly declining as well; many of them can no longer brainstorm, code, think deeply, or write without…
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#116As a naturally curious person, nothing will stop me from learning about the topics that interest me. But school also taught me a lot of things that didn't interest me, and a lot of those things turned out to be useful anyway. I think if I had access to AI from a younger age, I'd have used it to skip learning the things I didn't care about, which would not have done me any favours.
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#117Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#118At this point I would support a ban on generative AI by anyone under 18, or even perhaps 21 years of age. A bunch of science fiction stories had "first connection to cyberspace" as a coming of age event, maybe those authors were on to something.
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#119AI has a way of exposing people. In this example, students who are there to get a degree from a prestigious institution, rather than to learn, are prone to take perceived shortcuts and proceed to come unstuck when their AI isn't there to do their work for them, such as in an exam.
When you're up against a deadline - and unless you're very good at time management you're frequently up against a deadline - it's going to be an irresistible lever to pull.
In times past, cheating would mean copying an answer off the Internet or off a friend, both of which are easy to detect. More sophisticated cheaters might spend an hour rewriting the solution to make it less obvious they cheated, but at some point the cost of cheating (time + risk of getting caught) starts exceeding the cost of just doing the assignment. AI changes this - you get a customized answer that doesn't show up in a database with no extra work.
The thing is, students fail to realize just what using AI robs them of. Struggling with the assignment is the entire point. You don't learn if the assignments are too easy; you need to have some challenge to push your brain to understand the material more deeply and to build those pathways to apply the knowledge in novel ways. You become more efficient and effective over time as that knowledge settles in and you get more proficient - one of the reasons why time-bounded exams still make sense (being fast is also a proxy measure for understanding).
Re: Failing grades soar with AI usage, dwindling math skills in Berkeley CS classes
#120Earlier quoted context omitted.
I doubt it. I'm stupid and I use LLMs a lot but I can still meditate for 30 minutes. But apparently some of the smartest people in the world have lost the skill? But the commenter haven't, because why, they're 15 years older and thus immune to the same LLM-effects? Plus, the issue with people having trouble sitting still for 30 minutes precede LLMs with decades.
I didn't say I'm immune to those effects, I'm including myself in this as well. (also, I'm not older than my colleagues). Most people definitely can't meditate for 30 minutes, so if you can do this, it's very impressive. Regardless, being able to think about poorly-defined problems and build completely new mental models from nothing is genuinely a really hard and uncomfortable task. If you don't use the skill you'll…
Maybe not traditional meditation, but I have no problem taking a 30 minute plus walk with nothing but my thoughts. It’s actually when I do most of my thinking. The other is in the shower/sauna where devices don’t work anyway.