Live data from Hacker News

What happens when people don't understand how AI works

theatlantic.com

11–20 of 359 posts

Re: What happens when people don't understand how AI works

#11
post #2

Someone said, "The AI you use today is the worst AI that you will ever use."

Someone also said the current AI is the less biased.

Future AI's will be more powerful but probably influenced to push users to spend money or have a political opinion. So they may enshitify...

Re: What happens when people don't understand how AI works

#12
post #6

Earlier quoted context omitted.

I can't tell any difference between Claude 3.5, 3.7 and 4 for coding. So today is the same AI I used last year. And based on current trajectory same I will use next year.

I can tell the difference between those versions of Claude quite easily. Not 10x better each version, but each is more capable and the errors are fewer.

But errors nonetheless.

Re: What happens when people don't understand how AI works

#13
post #8

> Few phenomena demonstrate the perils that can accompany AI illiteracy as well as “Chatgpt induced psychosis,” the subject of a recent Rolling Stone article about the growing number of people who think their LLM is a sapient spiritual guide. Some users have come to believe that the chatbot they’re interacting with is a god—“ChatGPT Jesus,” as a man whose wife fell prey to LLM-inspired delusions put it—while others a…

Psychosis will find anything as a seed idea to express itself, even as basic a pattern as someone walking in lockstep with the soon-to-be patient can trigger a break. So it's not surprising that LLM chats would do the same.

Yeah, but should we have psychosis force multipliers?

Re: What happens when people don't understand how AI works

#14
post #2

Someone said, "The AI you use today is the worst AI that you will ever use."

I can't tell any difference between Claude 3.5, 3.7 and 4 for coding. So today is the same AI I used last year. And based on current trajectory same I will use next year.

There is certainly a difference, however Anthropic did really well with 3.5 - far, far better than any other provider could do, so the steps from there been more incremental while other providers have been playing catch up (for example Google's Gemini 2.5 Pro is really their first model that's actually useful for coding in any way).

Re: What happens when people don't understand how AI works

#15
This is a good summary of why the language we use to describe these tools matters[1].

It's important that the general public understands their capabilities, even if they don't grasp how they work on a technical level. This is an essential part of making them safe to use, which no disclaimer or PR puff piece about how deeply your company cares about safety will ever do.

But, of course, marketing them as "AI" that's capable of "reasoning", and showcasing how good they are at fabricated benchmarks, builds hype, which directly impacts valuations. Pattern recognition and data generation systems aren't nearly as sexy.

[1]: https://news.ycombinator.com/item?id=44203562#44218251

Re: What happens when people don't understand how AI works

#16

> Few phenomena demonstrate the perils that can accompany AI illiteracy as well as “Chatgpt induced psychosis,” the subject of a recent Rolling Stone article about the growing number of people who think their LLM is a sapient spiritual guide. Some users have come to believe that the chatbot they’re interacting with is a god—“ChatGPT Jesus,” as a man whose wife fell prey to LLM-inspired delusions put it—while others a…

> Few phenomena demonstrate the perils that can accompany AI illiteracy as well as “Chatgpt induced psychosis,” the subject of a recent Rolling Stone article about the growing number of people who think their LLM is a sapient spiritual guide.

People have been caught in that trap ever since the invention of religion. This is not a new problem.

Re: What happens when people don't understand how AI works

#17
post #13
post #8

Earlier quoted context omitted.

Psychosis will find anything as a seed idea to express itself, even as basic a pattern as someone walking in lockstep with the soon-to-be patient can trigger a break. So it's not surprising that LLM chats would do the same.

Yeah, but should we have psychosis force multipliers?

We have that now, in social media. If you create some way for large numbers of people with the same nutty beliefs to easily communicate, you get a psychosis force multiplier. Before social media, nuttyness tended to be diluted by the general population.

Re: What happens when people don't understand how AI works

#18
I agree with the substance, but would argue the author fails to "understand how AI works" in an important way:

  LLMs are impressive probability gadgets that have been fed nearly the entire internet, and produce writing not by thinking but by making statistically informed guesses about which lexical item is likely to follow another
Modern chat-tuned LLMs are not simply statistical models trained on web scale datasets. They are essentially fuzzy stores of (primarily third world) labeling effort. The response patterns they give are painstakingly and at massive scale tuned into them by data labelers. The emotional skill mentioned in the article is outsourced employees writing or giving feedback on emotional responses.

So you're not so much talking to statistical model as having a conversation with a Kenyan data labeler, fuzzily adapted through a transformer model to match the topic you've brought up.

While thw distinction doesn't change the substance of the article, it's valuable context and it's important to dispel the idea that training on the internet does this. Such training gives you GPT2. GPT4.5 is efficiently stored low- cost labor.

Re: What happens when people don't understand how AI works

#19
post #2

Someone said, "The AI you use today is the worst AI that you will ever use."

That doesn't take into account how it will be used against its customers once they're dependent on it. As any other service inevitably will be.

It's like if we'd said the Youtube we used in 2015 was going to be the worst Youtube we'd ever use.

Re: What happens when people don't understand how AI works

#20
post #2

Someone said, "The AI you use today is the worst AI that you will ever use."

Someone also said the current AI is the less biased. Future AI's will be more powerful but probably influenced to push users to spend money or have a political opinion. So they may enshitify...

Given that no models are profitable for the parent company afaik, it's only a matter of time before the money-squeezing begins
Post reply on HN