181–190 of 240 posts
Earlier quoted context omitted.
That's the part most people miss—and here's why it actually matters. That signal is real, and it’s hard to ignore.
BINGO, now I know exactly what the problem is. I've fixed the issue and the code is now fully verified and production ready.
I have the opposite reaction, when it is confident, or says I am right, I accuse it of guessing to see what it says. I say "I think you are getting me to chase a guess, are you guessing?" 90% of the time it says "Yes, honestly I am. Let me think more carefully." That was a copypasta from a chat just this morning
Hulk: I'm always angry AI: I'm always guessing
I fear this will give license to people to act on their thoughts which maybe harmful for them in ways no one can even imagine right now.
When a LLM tells me I'm right, especially deep in a conversation, unless I was already sure about something, I immediately feel the need to go ask a fresh instance the question and/or another LLM. It sets off my "spidey-sense". I don't quite understand why other people seem to crave that. Every time I read about someone who has gone down a dark road using LLMs I am constantly amazed at how much they "fall" for the LL…
Nontechnical people simply don't have any idea about what LLMs are. Their only mental model comes from science fiction, plus the simple fact that we possess a theory of mind. It would be astonishing if people were able to casually not anthropomorphize LLMs, given that untold millions of years worth of evolution of the simian neocortex is trying to convince you that anything that talks like that must be another mind s…
That's an extreme downward punch. Have you not observed the marketing these LLM companies are themselves producing? They're intentionally misleading the public as to the capabilities of these systems.
> if people were able to casually not anthropomorphize LLMs
Of course they can. You just need to train them appropriately. No one is doing that. Companies are busy running around talking about the "end of coding" or the "end of work" because some extremely chinsy LLM models are around that they want to _sell you_.
Earlier quoted context omitted.
> Nontechnical people simply don't have any idea about what LLMs are. We're on HN, a highly technical corner of the internet, yet we see the same stuff here. It's not just non-technical people... I think one of the big dangers is that people (including us) are quick to believe "I'm better than that". Yet this is a bias conmen have been exploiting for millennia. The only real defense is not lulling yourself into a fal…
There’s nobody who knows how to fool you better than yourself.
Earlier quoted context omitted.
The "it's just math" argument may not be technically rigorous, but it's directionally correct. The unstated reasoning invites us to consider why this particular math would be conscious, but not many other forms of math all around us.
First, it seems you've shifted from "intelligent" to "conscious". "These math operations produce consciousness" is different from "these operations produce intelligence". Second, "it's just math" doesn't mean literally "it's a branch of algebra". It means "it's a computable function". So it can be relevant to the discussion only if you think that intelligence is somehow non-computable, and therefore that there are no…
>non-computable
Something like 70-80% of all humans believe in a soul or spirit, and of the remainder, many of them are unsure whether human like intelligence can be produced by computable processes.
So it wouldn’t be surprising that the OP does think there are non-computable processes going on in the brain.
Isn't this just Dale Carnegie 101? I've certainly never had a salesperson tell me that I'm 100% wrong and being a fool. And, tbh, I often try to remember to do the same.
Earlier quoted context omitted.
Great point! ;) Realizing that the people they’re targeting DO need that is kind of frightening.
They aren't "targeting" per se, at least not in this aspect. I think it's simpler than that. That's what's in their training data, so that's what they respond with. But it works out just as badly, because there are plenty of insecure people who need that, and the AI gives it to them, with all the "dangerously attached" issues following from that.