Live data from Hacker News

Three Inverse Laws of AI

susam.net

231–240 of 388 posts

Re: Three Inverse Laws of AI

#231
post #72

Earlier quoted context omitted.

> Asimov's laws of robotics are flawed too, of course. Almost all of Asimovs writing about the three laws is written as a warning of sorts that language cannot properly capture intent. He would be the very first person to say that they are flawed, that is the intent of them. He uses robots and AI as the creatures that understand language but not intent, and, funnily enough that's exactly what LLMs do... how weird.

I think you're vastly underestimating how little of human intent is really encoded in language in a strict sense, and how much nontrivial inference of intents LLMs do every day with simple queries. This used to be an apparently insurmountable barrier in pre-LLM NLP, and now it is just not a problem. Suppose I'm in a cold room, you're standing next to a heater, and I say "it's cold". Obviously my intent is that I want…

[deleted]

Re: Three Inverse Laws of AI

#232
This phrase always fascinates me : "AI-generated content must not be treated as authoritative without independent verification appropriate to its context."

I've heard the same thing expressed somewhat more concisely as "Never ask AI a question to which you don't already know the answer".

Which raises the question, and I do think it's an important one. Given that this is true, what function does AI answering a question actually serve? You can't rely on its output, so you have to go and check anyway. You could achieve precisely the same outcome by using search engines and normal research.

This, and for many other reasons, is exactly why I never ask it anything.

Re: Three Inverse Laws of AI

#233
post #62

Earlier quoted context omitted.

This is actually one of the things that made LLMs more usable for me. The default tone and style of writing they tend to use is nauseatingly annoying and buries information in prose that sounds like a corporate presentation.

In chatgpt, I start every session with "Caveman mode:". Works at the moment.

Will it go full grug brained developer and avoid complexity as its apex predator? Sounds like it would help.

https://grugbrain.dev

Re: Three Inverse Laws of AI

#234
post #85

Earlier quoted context omitted.

“LLMs can capture intent now” reads to me the same as: AI has emotions now, my AI girlfriend told me so. I don’t discredit you as a person or a professional, but we meatbags are looking for sentience in things which don’t have it, thats why we anthropomorphise things constantly, even as children. We are easily fooled and misled.

LLM's capturing intent is a capabilities-level discussion, it is verifiable, and is clear just via a conversation with Claude or Chatgpt. Whether they have emotions, an internal life or whatever is an unfalsifiable claim and has nothing to do with capabilities. I'm not sure why you think the claim that they can capture intent implies they have emotions, it's simply a matter of semantic comprehension which is tied to…

[dead]

Re: Three Inverse Laws of AI

#235

This phrase always fascinates me : "AI-generated content must not be treated as authoritative without independent verification appropriate to its context." I've heard the same thing expressed somewhat more concisely as "Never ask AI a question to which you don't already know the answer". Which raises the question, and I do think it's an important one. Given that this is true, what function does AI answering a questio…

"Give me the answer for: [x]. Provide sources".

Re: Three Inverse Laws of AI

#236
post #228

> I wish that each such generative AI service came with a brief but conspicuous warning explaining that these systems can sometimes produce output that is factually incorrect, misleading or incomplete. Guess what? Books in the library can be wrong, even peer-reviewed encyclopedias. Pages on the internet can be wrong, even Wikipedia. When accuracy is important, you must look at multiple sources. I think AI will get be…

Yes LLM text prediction and peer-reviewed encyclopedias are the same. Good on you throwing internet pages in there too, that brings balance or something

My understanding of the parent is more charitable: If your thinking process relies on being told only the truth, you are going to fare lousy in this world.

LLMs are an example, but so are random pages on the internet, a buch of stuff we get served by the media (mainstream or otherwise), "expert opinions" by biased or sponsored experts or experts in a different field, etc, etc.

As the popular quip goes: It ain’t what you don’t know that gets you into trouble. It’s what you know for sure that just ain’t so.

With LLMs, we actually do get the warnings: Here's the ChatGPT footer: ChatGPT can make mistakes. Check important info. For Claude: Claude is AI and can make mistakes. Please double-check responses.

Such disclaimers, if written, are usually hidden deeply in terms of use for a random website, not stated up front.

Re: Three Inverse Laws of AI

#237
post #6

I strongly disagree with this framing. It's patently insane to demand that humans alter their behavior to accommodate the foibles of mere machines, and it simply won't work in the majority of cases. Humans WILL anthropomorphize the AI, humans WILL blindly trust their outputs, and humans WILL defer responsibility to them. Asimov's laws of robotics are flawed too, of course. There is no finite set of rules that can con…

> It's patently insane to demand that humans alter their behavior to accommodate the foibles of mere machines You mean like stopping at a red light?

Maybe. Traffic lights directly enforce social contracts

LLMs are aren't so direct

Re: Three Inverse Laws of AI

#238
post #6

I strongly disagree with this framing. It's patently insane to demand that humans alter their behavior to accommodate the foibles of mere machines, and it simply won't work in the majority of cases. Humans WILL anthropomorphize the AI, humans WILL blindly trust their outputs, and humans WILL defer responsibility to them. Asimov's laws of robotics are flawed too, of course. There is no finite set of rules that can con…

It's as if the author hopes that enshrining these wishes in a law is going to makes a difference.

Re: Three Inverse Laws of AI

#239

Earlier quoted context omitted.

> You know it's just sugar, That is not the definition of a placebo. You take the placebo (whatever it is: could be a pill; could be some kind of task or routine) and you believe it is medicine; you believe it to be therapeutic. The placebo effect comes from your faith, your belief, and your anticipation that it will heal. If the pharmacist hands you a pill and says, “here, this placebo is sugar!” they have destroyed…

One, a placebo does not need to be given blindly. A sugar pill is a placebo, even if the recipient knows about it. An actual definition: "A placebo is an inactive substance (like a sugar pill) or procedure (like sham surgery) with no intrinsic therapeutic value, designed to look identical to real treatment." No mention of the user's belief. Two, real hard data proves that the placebo effect remains (albeit reduced) e…

  In psychology, the two main hypotheses of the placebo effect are expectancy theory and classical conditioning.[70]

  In 1985, Irving Kirsch hypothesized that placebo effects are produced by the self-fulfilling effects of response expectancies, in which the belief that one will feel different leads a person to actually feel different.[71] According to this theory, the belief that one has received an active treatment can produce the subjective changes thought to be produced by the real treatment. Similarly, the appearance of effect can result from classical conditioning, wherein a placebo and an actual stimulus are used simultaneously until the placebo is associated with the effect from the actual stimulus.[72] Both conditioning and expectations play a role in placebo effect,[70] and make different kinds of contributions. Conditioning has a longer-lasting effect,[73] and can affect earlier stages of information processing.[74] Those who think a treatment will work display a stronger placebo effect than those who do not, as evidenced by a study of acupuncture.[75]
https://en.wikipedia.org/wiki/Placebo#Psychology

The hypotheses hinge on the beliefs of the recipients. "The placebo effect" has always been largely psychological. That's the realm of belief.

To veer even further off-tangent, isn't it hilarious how the Wikipedia illustration of old Placebo bottles indicate that "Federal Law Prohibits Dispensing without a Prescription". Wouldn't want some placebo fiend to O.D.

Re: Three Inverse Laws of AI

#240
> I wish that each such generative AI service came with a brief but conspicuous warning explaining that these systems can sometimes produce output that is factually incorrect, misleading or incomplete.

EU. Nudge nudge. We need this law.

Post reply on HN