Live data from Hacker News

Why do we tell ourselves scary stories about AI?

quantamagazine.org

131–133 of 133 posts

Re: Why do we tell ourselves scary stories about AI?

#131

Earlier quoted context omitted.

Because they don't _understand_ things. If I teach an LLM that 3+5 is 8, it doesn't "get" that 4+5 is 9 (leave aside the details here, as I'm explaining for effect). It needs to be taught that as well, and so on. We understand exactly everything that goes into how LLMs generate answers. The line of consciousness, as we understand it, is understanding. And as far as what actually constitutes consciousness, we're not e…

> The line of consciousness, as we understand it, is understanding. Is it? I'm no expert, by any stretch, but where does this theory come from? I don't think anyone knows what consciousness is, or why we appear to have it, or even if we do have it. I don't even know that you're conscious. I could be the only conscious being in the universe and the rest of you are just zombies, with all the right external outputs to f…

Well we're not. Theory of mind is _understanding_ you're not.

Re: Why do we tell ourselves scary stories about AI?

#132

Earlier quoted context omitted.

Because they don't _understand_ things. If I teach an LLM that 3+5 is 8, it doesn't "get" that 4+5 is 9 (leave aside the details here, as I'm explaining for effect). It needs to be taught that as well, and so on. We understand exactly everything that goes into how LLMs generate answers. The line of consciousness, as we understand it, is understanding. And as far as what actually constitutes consciousness, we're not e…

Leave aside "the details" like you being obviously, provably wrong? We've known for a long while that even basic toy-scale AIs can "grok" and attain perfect generalization of addition that extends to unseen samples. Humans generalize faster than most AIs, but AIs generalize too.

Then prove I'm wrong. Prove that an LLM can in fact solve completely novel arithmetic.

Re: Why do we tell ourselves scary stories about AI?

#133

Earlier quoted context omitted.

> The line of consciousness, as we understand it, is understanding. Is it? I'm no expert, by any stretch, but where does this theory come from? I don't think anyone knows what consciousness is, or why we appear to have it, or even if we do have it. I don't even know that you're conscious. I could be the only conscious being in the universe and the rest of you are just zombies, with all the right external outputs to f…

Well we're not. Theory of mind is _understanding_ you're not.

We're not what?

Can you please elaborate a bit more because your comment in isolation is meaningless.

Post reply on HN