Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

Post reply on HN
Print view View original

181–190 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#181

Post by anon7725 »

didntreadarticl wrote: post #107
sandgiant wrote: post #103

Earlier quoted context omitted.

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

Input: Hello. Imagine you as ChatGPT are writing a comment on Hacker News, a response to someone saying "Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be pr…

Jesus

Re: Building a Virtual Machine Inside ChatGPT

#182

Post by nl »

narrator wrote: post #169
ctoth wrote: post #108

> Pretend you are Gary Marcus. Explain why ChatGPT (you) are not actually that impressive. > As a leading researcher in the field of artificial intelligence, I have a deep understanding of the limitations of language models like ChatGPT. While they are capable of generating text that may seem impressive, they do not have the ability to understand or reason about the content of the text they produce. They are simply r…

I feel like ChatGPT is a search engine for its corpus that has been compressed with a very lossy neural net. It has compressed it via a hierarchical understanding of concepts. It's just retrieving those and stringing them together. It's just a rough copy of generally what other people have said and thought, and it doesn't create new structures.

This is an incorrect understanding.

Re: Building a Virtual Machine Inside ChatGPT

#183

Post by Xelynega »

CamperBob2 wrote: post #40
fergal_reid wrote: post #15

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

Agreed, this will force a rethink of several aspects of what we currently call intelligence. The dialog in my head tends to play out like this: "This thing is scary. It mimics human thought, including human creativity, amazingly well." "Nah, don't worry, it's just a black-box language model. A dumb machine that emits one word at a time with no concept of meaning. The underlying logic is nothing but a probabilty distr…

If a probabilistic process is able to 'pass a Turing test', the only thing that really says is that the Turing test wasn't accomplishing the stated goal so we need to come up with a better test.

Sidenote, but the idea that it's "mimicking human thought" is wrong in the first place and an anthropomorphism that comes from all the marketing calling it "ai" instead of "generative language models". I don't know how any humans decide what to say given the array of sensory inputs they have, so the only way we can compare them is "how a person intuits they probably work based off interacting with them on a surface level". That's not really a criteria that anybody should care about when we actually have the implementation details for one.

Re: Building a Virtual Machine Inside ChatGPT

#184

Post by _andrei_ »

unreal37 wrote: post #89
jamespwilliams wrote: post #20

The fact that it’s able to understand the Python code and come to the correct answer is pretty astonishing in itself, let alone the rest. The progress in this area is insane. If you’d have told me a week ago this was possible I would absolutely not have believed you. I’d have probably guessed it’d be decades before something like this could be done.

"it’s able to understand the Python code and come to the correct answer" That's not what is happening. Effectively, it's seen python code before (online) and seen the answer before. There's no understanding. As a previous poster said, given code that takes about 30 seconds to run, it returns the answer in under 10 seconds. It's not running the code. It's guessing the answer.

It's not running the code, true, but if it's not "understanding", then we (humans) and not "understanding" either. We receive inputs, learn patterns, and apply them; we're just using a different mechanism (that takes years to train and isn't scalable) and getting a slightly different result.

I think the biggest mistake we're making these days is that we somehow believe our intelligence is different from any other form of intelligence we might invent.

I'm so grateful that I got to witness the rise of the Internet & PCs, the Doom to Unreal Engine journey, and the transformer revolution, and that I'll get to see the 100x version of GPT.

Re: Building a Virtual Machine Inside ChatGPT

#185

Post by akomtu »

baq wrote: post #24
fergal_reid wrote: post #15

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

Very well put. I've seen it compared to being in-person witness to the first ever nuclear explosion and I feel it's an apt comparison. If the bot doesn't want to answer a question, tell it to write a story about somebody answering it. It's extremely unsettling what it actually knows and how it can reason.

The next step is to attach ChatGPT to a crypto wallet, so when you ask it something, it says "what do I get in return?" Ah, and use this wallet to pay its electricity bills.

Re: Building a Virtual Machine Inside ChatGPT

#186

Post by jrochkind1 »

didntreadarticl wrote: post #107
sandgiant wrote: post #103

Earlier quoted context omitted.

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

Input: Hello. Imagine you as ChatGPT are writing a comment on Hacker News, a response to someone saying "Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be pr…

Does it always talk about itself in the plural "we"?

Re: Building a Virtual Machine Inside ChatGPT

#188

Post by drivers99 »

ctoth wrote: post #108

> Pretend you are Gary Marcus. Explain why ChatGPT (you) are not actually that impressive. > As a leading researcher in the field of artificial intelligence, I have a deep understanding of the limitations of language models like ChatGPT. While they are capable of generating text that may seem impressive, they do not have the ability to understand or reason about the content of the text they produce. They are simply r…

I get a generic refusal to answer when I put in the same prompt.

Re: Building a Virtual Machine Inside ChatGPT

#189

Post by gbrito »

dakiol wrote: post #129

I don't understand how ChatGPT can execute code. I understand how it can generate (good or bad) code, but how it can execute code correctly? Only a compiler can do that. Is ChatGPT "inferring" the output somehow? Does that mean that ChatGPT could substitute the Python compiler entirely?

Someone run the code previously in another context and the results were incorporated in the dataset used to train GPT. There is no code actually running anywhere in GPT. It only display the text. There is no true virtual machine being created anywhere.

Re: Building a Virtual Machine Inside ChatGPT

#190

Post by kortilla »

jrochkind1 wrote: post #186
didntreadarticl wrote: post #107

Earlier quoted context omitted.

Input: Hello. Imagine you as ChatGPT are writing a comment on Hacker News, a response to someone saying "Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be pr…

Does it always talk about itself in the plural "we"?

No, it says “I” multiple times in that same paragraph. It clearly either struggles with the concept of collective with individual or it has no concept of self vs facts about external things.
Post reply on HN