Earlier quoted context omitted.
[flagged]
Cybersecurity does indeed work closely with HR and legal. Especially cybersecurity consultants in the IR space like me. You didn’t answer my question.
[flagged]
Is AI reasoning right for the wrong reasons?
141–150 of 268 posts
Re: Is AI reasoning right for the wrong reasons?
#142Earlier quoted context omitted.
I find your comment extremely arrogant and condescending. Society will adapt and they don't need people gatekeeping AI or LLMs with all sorts of prophecies and dooming. Why should I feel bad about working 3 remote jobs with the help of AI ?
Do your three employers know that you're doing this? if not, it's fraud, and you'd better hope that they don't catch on. Check your employment paperwork.
Fraud is normal in the current economy. The more fraud you do, the more you are rewarded. Everywhere from the highest levels to the lowest.
Re: Is AI reasoning right for the wrong reasons?
#143LLMs lack qualia, among other things. If I ask an LLM "what is an apple?" it tells me: > An apple is the edible fruit of the apple tree, scientifically known as Malus domestica. It is one of the world's most widely grown fruits and is eaten fresh or used in many foods and drinks. If I ask an LLM "what is a mundu fruit?" it tells me: > Mundu is a tropical fruit native to Southeast Asia, especially found in Indonesia,…
> but without any lived experience perhaps that's an unreasonable expectation.
I don't think that follows. We learn via our perception (i.e. our inputs from the outside world); our perception is mediated by some kind of filter, and memories get written or altered. An LLM on the other hand has static weights. You can provide an LLM a "facts.md" (or whatever) file that "teaches" it stuff that's not in its weights (via the context), and it can use the combination to produce something, but that set of information never modifies its core weights. You could imagine a robot with an LLM inside it that has all kinds of sensors, and processes that write the observations from those sensors into a bunch of databases which are RAG'ed into prompts to simulate learning and experiences, perhaps (jefe likes her coffee with almond milk). But my point is that, architecturally, they don't learn - and that's the bigger obstacle.
PS garcinias seem to be generally delicious.
Re: Is AI reasoning right for the wrong reasons?
#144Back in the day it was a bit of a cliche to bring up “clever Hans”, the horse that could do math, when talking about machine learning. He couldn’t do math but he read some cues from his handler of pick the write answers, the handler iirc wasn’t in on it. The point of the story was that classifiers can be right for the wrong reasons and almost inevitably are. At least there’s zero guarantee that the reason for making…
> They do what their handler wants to see, that’s all, and that’s what they’re trained to do. This sounds like a tautological argument that doesn't really mean anything. Hypothetically, in a near future a super-powerful AI could bring something truly astonishing (say, practical fusion power, or cure all cancer) and one could still argue "They do what their handler wants to see, that's all." So what does that even mea…
They are already producing truly astonishing results. The unit distance problem and Jacobian conjecture are world-famous problems that stood unsolved for 80 and 87 years. Entire careers have been spent on them. Yitang Zhang for example spent his entire PhD trying and failing to prove the latter in the 2-dimensional case.
Re: Is AI reasoning right for the wrong reasons?
#145Back in the day it was a bit of a cliche to bring up “clever Hans”, the horse that could do math, when talking about machine learning. He couldn’t do math but he read some cues from his handler of pick the write answers, the handler iirc wasn’t in on it. The point of the story was that classifiers can be right for the wrong reasons and almost inevitably are. At least there’s zero guarantee that the reason for making…
Aren't humans also classifiers? Where, precisely, is the dividing line between a sufficiently large model and an intelligence?
Is that all humans are? When clockwork was the frontier, people thought the brain was akin to clockwork (which is why the mechanical turk fooled people). By analogy, now that classifiers are the frontier, we think the brain is a classifier. Our model of the mind is whatever the most complex artifact of our era is .
Just to be clear: I do think the brain classifies. But I wonder if it does other operations as well that we don't fully understand.
Re: Is AI reasoning right for the wrong reasons?
#146An intuitive explanation for why reasoning tokens help is to remember that LLMs are just mathmatical functions f() that take in an input sequence x and produces the next token f(x). Without reasoning tokens, you require the function f() to immediately take you from x to the start of an output sequence that is a correct answer. With reasoning tokens, this is much relaxed, allowing for many repeated applications of f()…
The article is about existing research suggesting that this intuition is incorrect, though.
Re: Is AI reasoning right for the wrong reasons?
#147LLMs lack qualia, among other things. If I ask an LLM "what is an apple?" it tells me: > An apple is the edible fruit of the apple tree, scientifically known as Malus domestica. It is one of the world's most widely grown fruits and is eaten fresh or used in many foods and drinks. If I ask an LLM "what is a mundu fruit?" it tells me: > Mundu is a tropical fruit native to Southeast Asia, especially found in Indonesia,…
> We want them to understand what's We want them to assess what's true and what's not.
We want them to better predict consequences of their outputs.
Re: Is AI reasoning right for the wrong reasons?
#148LLMs do not reason. They also have a very different moral compass than humans. Maybe stop hurling trash articles at everyone
Re: Is AI reasoning right for the wrong reasons?
#149Earlier quoted context omitted.
That’s just conflating reasoning and “parallel reconstruction” - there is such thing as reasoning, and I agree it’s probably less common in decision making, but it’s fundamental to many tasks where we figure out a solution, like writing an algorithm, math proofs, etc.
Maybe, but I suspect that a lot of the actual things that produce the algorithm, proof, etc are not actually explicit reasoning. Q: "Why did you try that vs some other thing at this point?" A:"seemed right to do"/"kinda looks like other stuff I've seen before"/"first thing that came to mind" etc. Why pursue this one avenue vs some other, typically its cause it seemed more promising, and the person can come up with re…
Exactly. Very little of what we do is "explicit thinking", because it's slow to have to develop and verbalise those arguments step by step. Most of it is "hunches" that we then retroactively justify if asked, and those retroactive justifications were demonstrated not to be trustworthy by Sperry's experiments. We don't even have evidence to suggest that humans can reliably introspect our past decisions, but we do have evidence to suggest we readily manufacture them.
Re: Is AI reasoning right for the wrong reasons?
#150Earlier quoted context omitted.
Aren't humans also classifiers? Where, precisely, is the dividing line between a sufficiently large model and an intelligence?
Is that all humans are? When clockwork was the frontier, people thought the brain was akin to clockwork (which is why the mechanical turk fooled people). By analogy, now that classifiers are the frontier, we think the brain is a classifier. Our model of the mind is whatever the most complex artifact of our era is . Just to be clear: I do think the brain classifies. But I wonder if it does other operations as well tha…
[deleted]