My concern is the assessment divide. In the district I live I happen to be on a parent board that's providing input to the leadership with respect to technology. Privacy and security are a huge component of LLMs currently, but beyond that I think the biggest area of interest is the assessment divide.
Currently the district is looking at it through the lens of having students still "test" in traditional ways so that if, and when, assessment doesn't align with daily work they can start to understand where this divide exists.
I really like the Ted Chiang quote from the article: "Using ChatGPT to complete assignments is like bringing a forklift into the weight room; you will never improve your cognitive fitness that way". I can already see this divide in some of the surrounding friend-circle wherein a lot of young (under the age of 12) are leveraging LLMs very heavily to direct them. I fear that these kids will lose the confidence, at a very early age, to even start something. It's widely discussed how getting started in projects is often the most cumbersome in a task timeline, and so without making things uncomfortable for this young generation to work at this skill I feel as though we're going to see the start of a significantly handicapped generation because they will over-rely on these tools. And, really, this is just one of many issues of over-reliance.
> Now the youth is going to be more and more clever and not necessarily more intelligent instead because that is what is valued, taking a shortcut that technology enables.
I 100% agree with this. A lot of students will fool their parents, and even a number of educators by leveraging this new "cleverness". But it's going to hit a dead end as soon as they're forced to do. I also think you're right in that this may become a class divide that further segments the population and also provides facilities for unfortunate control over the lower class through trained and targeted LLM responses.