Live data from Hacker News

Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

newyorker.com

21–30 of 164 posts

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#21
What I heard him say is that people are taking away present-day jobs, hoping new ones will rise from the ashes. Yet, he also claims we need to find the creative minds who will actually create these new roles.

I'm curious: have we found those people or those new jobs yet? Is a forward deployed engineer an example of this, yet they are now doing the job of two people (sales and coding).

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#22

We're choosing to call LLMs (and the little "harness" programs that query them in loops and execute their output) "AI", even though it doesn't make much sense. I absolutely love this technology but these aren't autonomous intelligences. They're little programs executing Bash scripts from JSON output. Our ideas about AI were naive. We thought passing a basic Turing test would require human-like intelligence. It turned…

Oh, you're talking about "AGI"! In the 90's we started using the term, you should catch up!

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#23

Earlier quoted context omitted.

> It would've been nice to reserve "AI" for superior human-like intelligence capable of genuine common sense and reasoning. What would a frontier API have to be able to do to satisfy you?

Maybe just a very rigorous version of the Turing test? Modern LLMs can superficially simulate conversation but it's trivial to force them into revealing their non-human like intelligence. They've been "patched" since but all models fail basic tests like "Should I walk or drive to the car wash which is 100 feet away" by recommending you walk. So you'd just ask questions that require theory of mind, abstract and common…

Can you give me one example that works on Claude right now?

I'm never sure whether this indicates "no reasoning present" or you've just hit an odd behaviour in the AI such that its reasoning fails. For example, you present a problem in a way that's dissimilar to the way problems are presented in its training set. That doesn't mean it's not reasoning, just it can only reason correctly in some circumstances.

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#24

Earlier quoted context omitted.

> It would've been nice to reserve "AI" for superior human-like intelligence capable of genuine common sense and reasoning. What would a frontier API have to be able to do to satisfy you?

Maybe just a very rigorous version of the Turing test? Modern LLMs can superficially simulate conversation but it's trivial to force them into revealing their non-human like intelligence. They've been "patched" since but all models fail basic tests like "Should I walk or drive to the car wash which is 100 feet away" by recommending you walk. So you'd just ask questions that require theory of mind, abstract and common…

I would walk

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#25

We're choosing to call LLMs (and the little "harness" programs that query them in loops and execute their output) "AI", even though it doesn't make much sense. I absolutely love this technology but these aren't autonomous intelligences. They're little programs executing Bash scripts from JSON output. Our ideas about AI were naive. We thought passing a basic Turing test would require human-like intelligence. It turned…

> It would've been nice to reserve "AI" for superior human-like intelligence capable of genuine common sense and reasoning. What would a frontier API have to be able to do to satisfy you?

Can it produce a chart topping album if its given all the tools and the prompt "produce chart topping album" .

you might say almost no humans can do tht either but some human can but no ai can.

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#26

We're choosing to call LLMs (and the little "harness" programs that query them in loops and execute their output) "AI", even though it doesn't make much sense. I absolutely love this technology but these aren't autonomous intelligences. They're little programs executing Bash scripts from JSON output. Our ideas about AI were naive. We thought passing a basic Turing test would require human-like intelligence. It turned…

> It would've been nice to reserve "AI" for superior human-like intelligence capable of genuine common sense and reasoning. We've called that "AGI" since the late 90s/early 00s (depending on whether you count first use or popularization). Even if AGI does come to pass, we'll still need "AI" since not all forms of AI will be AGI.

[deleted]

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#27

We're choosing to call LLMs (and the little "harness" programs that query them in loops and execute their output) "AI", even though it doesn't make much sense. I absolutely love this technology but these aren't autonomous intelligences. They're little programs executing Bash scripts from JSON output. Our ideas about AI were naive. We thought passing a basic Turing test would require human-like intelligence. It turned…

This no news for people who study philosophy, as it was known since the 1980s when John Searle described the Chinese room thought experiment.

Even Turing him self did envision the Turing test as something to pass as intelligence, but rather as a more useful replacement for the troubled term.

That said, I think your quest is doomed. There will never be a superior human-like intelligence. Forever is a long time, but my reasoning for believing this is the same reason Turing offered a replacement. Intelligence is way too vague to be useful as a measurement for anything. And if we ever discover something that is more intelligent them humans (by whichever definition of intelligence) we will simply redefine intelligence to exclude that.

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#28

We're choosing to call LLMs (and the little "harness" programs that query them in loops and execute their output) "AI", even though it doesn't make much sense. I absolutely love this technology but these aren't autonomous intelligences. They're little programs executing Bash scripts from JSON output. Our ideas about AI were naive. We thought passing a basic Turing test would require human-like intelligence. It turned…

We've chosen to call Deep Blue and Half-Life 1 NPCs "AI" too. It boggles my mind that this "b-b-but it's not actual real AI" whine is even a thing. Were people saying this living in the cave for the past 5 decades of AI research?

[deleted]

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#29

Earlier quoted context omitted.

To answer for OP: We are now calling text and image generators "intelligent" in the same way a spell checker is intelligent. Whatever it's become, "AI" research started as a way to study digital neurology, or how to digitize a mind, not just how to generate data. The Turing Test should have had a caveat, it needs to fool a, "non-stupid" person, and we still have not gotten even close to passing that version.

What exactly would a 'non-stupid' person do to catch the latest models on a Turing Test? Aside from being aware of AI 'tells' like em-dashes.

If this was true. I would repalce myself with ai that pretends to be me on slack.

my coworkers would know almost immediately if i did that.

Re: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)

#30

Earlier quoted context omitted.

We've chosen to call Deep Blue and Half-Life 1 NPCs "AI" too. It boggles my mind that this "b-b-but it's not actual real AI" whine is even a thing. Were people saying this living in the cave for the past 5 decades of AI research?

You can call your little doggy "AI" if it makes you happy. But when you call something "AI" and it tells you to walk instead of drive to the car wash, you're not talking about the "AI" science fiction authors were dreaming of.

Sure, just keep moving the goalposts. It's not a "real AI" because it can't take over the US military command and kick off WW3 and finish the survivors off with killer robots yet!
Post reply on HN