It's important to factor in just how many US adults are basically illiterate nowadays.
As of 2023, 27% of American working-age adults were at a PIAAC Literacy Level of 1 or below, out of a total of 5 levels. This has gotten drastically worse in the past 10 years as, in 2013, Level 1 and below was only 17%.
Full scores for 2023 are:
% Level 1 or below: 27%
Level 2: 29%
Level 3: 31%
Level 4/5: 13%
For reference, Level 1 means someone can't really handle a full page of text, and can sort of handle simple 1-page web pages. Level 2 is the point where someone can start to handle a few pages of straightforward text, but still nothing particularly complicated.
(Both of those descriptions undersell just how bad it really is, but I'll leave it at that, for the sake of brevity.)
People that aren't using AI at all often aren't using it because they effectively can't. On a fundamental level.
Source: https://nces.ed.gov/surveys/piaac/2023/national_results.asp