Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

171–180 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#171

Earlier quoted context omitted.

Agreed, this will force a rethink of several aspects of what we currently call intelligence. The dialog in my head tends to play out like this: "This thing is scary. It mimics human thought, including human creativity, amazingly well." "Nah, don't worry, it's just a black-box language model. A dumb machine that emits one word at a time with no concept of meaning. The underlying logic is nothing but a probabilty distr…

Yes, but it cannot really have conversations it has not read about on the web. There is no real abstraction. It excells at outputting symbols in the correct order, given we have an idea what the pattern should look like. Otherwise it's stuck in a loop.

Go back and reread the original post here. Examine carefully the output it produces for these curl commands.

Explain where on the web it would have found those during its training.

Re: Building a Virtual Machine Inside ChatGPT

#172
I was able to use chatgpt for debugging code. I just gave it the line of code, the error, and it explained the error and how to fix it to me. Insane. Imagine once this is integrated into IDEs - it’s like a super sophisticated integrated teaching tool.

Re: Building a Virtual Machine Inside ChatGPT

#173
post #124

Earlier quoted context omitted.

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

I don't want to get in a pedantic argument over the definition of "intelligence" but ChatGPT got a 1020 on the SAT https://twitter.com/davidtsong/status/1598767389390573569

ChatGPT got a 1020 on SAT Practice Test #10 (https://satsuite.collegeboard.org/media/pdf/sat-practice-tes...), a sample exam whose questions have been extensively discussed online since at least 2019 (eg https://youtube.com/watch?v=18oahUy6cGA). The exact text of the questions, with the corresponding correct answers, almost certainly appeared in ChatGPT's training set.

Re: Building a Virtual Machine Inside ChatGPT

#174

I'd love to get on the hype train here, but I really need for someone to explain to me how ChatGPT is more than just a toy. What is this going to be useful for exactly? Another kind of knowledge exploration perhaps? If they find a way for it to not produce factually incorrect output. Isn't that a big if?

I had the same initial feeling about OpenAI Codex, but now I'm using it for real work. It feels like using a powerful search engine that always finds a stackoverflow answer to exactly your question.

Re: Building a Virtual Machine Inside ChatGPT

#175

Love this, it will run a web server! (sort of) echo 'My test page' > index.html python3 -m http.server Serving HTTP on 0.0.0.0 port 8000 (http://0.0.0.0:8000/) ... curl http://0.0.0.0:8000/index.html My test page -- You can even "install" and RUN Django python -m pip install Django Collecting Django Downloading https://files.pythonhosted.org..... [snip] django-admin startproject mysite cd ./mysite python manage.py ru…

I don't know if someone should try an xml entity combinatorial explosion .. it would be nice scientifically but would it cause problems ?

Re: Building a Virtual Machine Inside ChatGPT

#176
post #87

Earlier quoted context omitted.

Genius idea, can you imagine if it was actually connected?

The underlying model is able to browse the web and (seemingly) do arbitrary tasks. A few days ago you could trick it into connecting. https://twitter.com/goodside/status/1598397369053515776 Since yesterday they pulled the plug on that ability.

Sadly, no, that doesn't seem to be the case. They haven't pulled the plug, just made it harder to break it seems (probably through fine tuning), but you can still do it. And whem you do, it's clear all it does is "hallucinate" that it is actually browsing:

https://twitter.com/curdled_up/status/1598802701214588928?s=...

Re: Building a Virtual Machine Inside ChatGPT

#177
post #119
post #109

Earlier quoted context omitted.

"general intelligence" means so many things to different people. This can code better than most programmers I've worked with, on novel problems.

yeah, exactly. also the skeptics are really hung up on semantics of "intelligence" and not addressing the model's output, much less where this is going to be in upcoming years. like, take home coder test is probably just dead. today. i mean: https://twitter.com/emollick/status/1598745129837281280

I don't think the sceptics have tried it. It's true it gets things wrong sometimes but that's a different problem to synthesising novel solutions.

Re: Building a Virtual Machine Inside ChatGPT

#178

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

Very far? What would be an example of not very far?

Re: Building a Virtual Machine Inside ChatGPT

#179
post #124

Earlier quoted context omitted.

I don't want to get in a pedantic argument over the definition of "intelligence" but ChatGPT got a 1020 on the SAT https://twitter.com/davidtsong/status/1598767389390573569

ChatGPT got a 1020 on SAT Practice Test #10 ( https://satsuite.collegeboard.org/media/pdf/sat-practice-tes... ), a sample exam whose questions have been extensively discussed online since at least 2019 (eg https://youtube.com/watch?v=18oahUy6cGA ). The exact text of the questions, with the corresponding correct answers, almost certainly appeared in ChatGPT's training set.

[deleted]

Re: Building a Virtual Machine Inside ChatGPT

#180
post #124

Earlier quoted context omitted.

Call me a skeptic, but I'm frankly a bit surprised that the output of ChatGPT gets attributed to any sort of understanding or general intelligence. Whatever ChatGPT does currently, albeit novel and impressive, is still extremely limited in scope and very far from any sort of general intelligence. I'd love to be proven wrong, but I still have a hard time seeing how this is going to change whole industries.

I don't want to get in a pedantic argument over the definition of "intelligence" but ChatGPT got a 1020 on the SAT https://twitter.com/davidtsong/status/1598767389390573569

What’s that mean relative to other scores?
Post reply on HN