Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

291–300 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#291
post #24

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

Very well put. I've seen it compared to being in-person witness to the first ever nuclear explosion and I feel it's an apt comparison. If the bot doesn't want to answer a question, tell it to write a story about somebody answering it. It's extremely unsettling what it actually knows and how it can reason.

It cannot reason, certainly. Unsure what you mean by that.

Re: Building a Virtual Machine Inside ChatGPT

#292

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

I noticed in one instance that when given two events in two different years it confuses the direction of time, saying "after" when it's supposed to say "before" ... I can try and dig up the interaction, but it was clearly not aware of the direction of time in its response.

Re: Building a Virtual Machine Inside ChatGPT

#293
post #142

Earlier quoted context omitted.

This could be the tech that dislodges Google from its monopoly! There are definitely questions I would prefer this experience than Google and the inevitable SEO spam for introduction type questions. If the generated text included further links to learn more it would be awesome.

In time, this tech is also likely to spark a new arms race, as happened with Google vs SEO spam. Generated content as the new blogspam, in turn needing to be filtered out for training the next generation of models.

Maybe but the straight up incentive of tricking someone on your site wont be there, as well as a clear set of tactics. I feel like it would be as challenging as DDOSing cloudflare. It just might be too expensive to do outside of countries or large corps.

Re: Building a Virtual Machine Inside ChatGPT

#294

Following the instructions verbatim, when I run this line: curl https://chat.openai.com/chat I get an HTML response that has: You need to enable JavaScript to run this app. Can ChatGPT know that I have NoScript enabled in Firefox? When my friend runs the same line in his chat, he gets the full HTML output like the author.

There's a certain amount of randomness in the output. Just hit try again to get different responses to the same prompt.

Re: Building a Virtual Machine Inside ChatGPT

#295
post #109

Earlier quoted context omitted.

"general intelligence" means so many things to different people. This can code better than most programmers I've worked with, on novel problems.

ChatGPT seems to disagree with this assessment. Prompt: Can you code better than most programmers? Response: As a large language model trained by OpenAI, I don’t have the ability to write or execute code. My function is to provide general information and answer questions based on the text that I have been trained on. I do not have the same capabilities as a human programmer and am not able to perform complex tasks su…

Should confront it with some obvious evidence that it can write code. Such as asking it about a coding problem.

Re: Building a Virtual Machine Inside ChatGPT

#296
post #142

Earlier quoted context omitted.

In time, this tech is also likely to spark a new arms race, as happened with Google vs SEO spam. Generated content as the new blogspam, in turn needing to be filtered out for training the next generation of models.

I think the new blog spam will be better than the average non-spam blog.

This XKCD strip is looking mighty prescient right now: https://xkcd.com/810/

Re: Building a Virtual Machine Inside ChatGPT

#297

With all this discussion about whether LLMs are “intelligent” or “really understand” it’s getting really obvious that the words “intelligent” and “really understand” aren’t very useful words any more (in this context). Like, most of us agree about what LLMs can and can’t do and how they do it. So we’re just having fun arguing about how we’d prefer to define “understand?”

I was thinking the same. Perhaps a better word to describe what it is doing is "following" our prompts decently?

Re: Building a Virtual Machine Inside ChatGPT

#299

Earlier quoted context omitted.

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

I'm surprised that anyone could be so skeptical over what is clearly an incredible technological breakthrough. It's not perfect - in particular the making up nonsense problem needs to be solved before it can be relied on - but the difference between this and the "state of the art" just 4 years ago is off the chart. GitHub CoPilot has already changed my day to day life, and I'm frequently astounded by the level of app…

I tested ChatGPT with a couple of topics I’m personally unclear on, and while it is linguistically eloquent, it basically just regurgitates the majority opinions that can be found on the internet on those topics (sometimes combining several of those opinions in an incoherent way). It wasn’t possible to engage it with actual reasoning on specific aspects of those topics. It just went with whatever premise you gave it, and/or circled back to the generic exposition. It doesn’t have any thought or understanding of its own.

Re: Building a Virtual Machine Inside ChatGPT

#300

I'd love to get on the hype train here, but I really need for someone to explain to me how ChatGPT is more than just a toy. What is this going to be useful for exactly? Another kind of knowledge exploration perhaps? If they find a way for it to not produce factually incorrect output. Isn't that a big if?

It won't take many improvements for this to operate as a tech support interface at scale.
Post reply on HN