Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

211–220 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#211

Earlier quoted context omitted.

Does it always talk about itself in the plural "we"?

No, it says “I” multiple times in that same paragraph. It clearly either struggles with the concept of collective with individual or it has no concept of self vs facts about external things.

Or you're hearing from Locutus of Borg...

Re: Building a Virtual Machine Inside ChatGPT

#212
post #124

Earlier quoted context omitted.

I don't want to get in a pedantic argument over the definition of "intelligence" but ChatGPT got a 1020 on the SAT https://twitter.com/davidtsong/status/1598767389390573569

ChatGPT got a 1020 on SAT Practice Test #10 ( https://satsuite.collegeboard.org/media/pdf/sat-practice-tes... ), a sample exam whose questions have been extensively discussed online since at least 2019 (eg https://youtube.com/watch?v=18oahUy6cGA ). The exact text of the questions, with the corresponding correct answers, almost certainly appeared in ChatGPT's training set.

Prompt: Would a chatbot scoring 1020 on an SAT practice test whose questions and answers were part of its training data be evidence of general understanding?

ChatGPT Response: A chatbot scoring 1020 on an SAT practice test whose questions and answers were part of its training data would not necessarily be evidence of general understanding. Scoring well on a standardized test like the SAT requires a specific set of skills and knowledge, but it does not necessarily indicate that the chatbot has a general understanding of the world or the ability to think and reason like a human.

Standardized tests like the SAT are designed to measure specific abilities and knowledge, and a chatbot that has been trained on the questions and answers from the test would be able to perform well on the test by simply recognizing and reproducing the correct answers. This type of performance does not necessarily indicate that the chatbot has a deep understanding of the material or the ability to apply it in a broader context.

Re: Building a Virtual Machine Inside ChatGPT

#213
Following the instructions verbatim, when I run this line:

  curl https://chat.openai.com/chat
I get an HTML response that has: You need to enable JavaScript to run this app.

Can ChatGPT know that I have NoScript enabled in Firefox? When my friend runs the same line in his chat, he gets the full HTML output like the author.

Re: Building a Virtual Machine Inside ChatGPT

#214

I've spent a couple of hours playing with ChatGPT since it was released and I am convinced people are not freaking out about it enough. It is well beyond merely retrieving compressed knowledge; I see a lot of capability for synthesis and what I can only call 'understanding'. I think a lot of people are getting tripped up by the fact it's trained to be very conservative in terms of what topics it will discuss. It's ea…

This could be the tech that dislodges Google from its monopoly! There are definitely questions I would prefer this experience than Google and the inevitable SEO spam for introduction type questions. If the generated text included further links to learn more it would be awesome.

> If the generated text included further links to learn more it would be awesome.

A new type of language model has been developed that takes a query as input and produces document IDs as output, similar to how Google works, but without relying on an inverted index of keywords. This model can be used on any text to obtain the most relevant references.

Re: Building a Virtual Machine Inside ChatGPT

#215
post #128

Earlier quoted context omitted.

>Can anyone please explain to me why this isn't as wildly groundbreaking as this seems? It is and people haven't realize it yet.

But isn't it just predicting text patterns? It doesn't really know about Docker, just that after running commands X,Y you usually get output Z (of course with the stateful AI magic to make things more stable/consistent).

I mean not to veer to far into the philosophical side of this, but what does it actually mean to know or understand something?

Did you see the demo the other day that was posted here of using stylographic analysis to identify alt accounts? Most of the comments were some form of "holy shit this is unbelievable", and the OP explained that he had used a very simple type of analysis to generate the matches.

We aren't quite as unique as we think was my takeaway from that. My takeawy from this, as well as the SD, DALL-E stuff is that we're all just basically taking what we heard from the past, modifying it a teeny bit, and spitting it back out.

Re: Building a Virtual Machine Inside ChatGPT

#216
post #142

Earlier quoted context omitted.

This could be the tech that dislodges Google from its monopoly! There are definitely questions I would prefer this experience than Google and the inevitable SEO spam for introduction type questions. If the generated text included further links to learn more it would be awesome.

In time, this tech is also likely to spark a new arms race, as happened with Google vs SEO spam. Generated content as the new blogspam, in turn needing to be filtered out for training the next generation of models.

I think the new blog spam will be better than the average non-spam blog.

Re: Building a Virtual Machine Inside ChatGPT

#217

Followed in these footsteps. Found you can get some fascinating results by asking the ‘vm’ to run commands like curl www.bbc.co.uk/news/headlines | grep war Also, in my ChatGPT’s virtual universe, the second story in the HTML on the front page of hacker news was The first artificial intelligence to evolve entirely inside a computer has been created

Update: while it is obviously not a working URL in the real world, inside the ‘vm’,

   curl https://www.nature.com/articles/d41586-020-03128-9
works and produces plausible HTML for a nature page with that title - and the following meta summary:

   
Sadly the actual content is paywalled.

Re: Building a Virtual Machine Inside ChatGPT

#218
post #41

It‘s also powerful to add „Only reply with a single word! Do not use more than one word.“ to every interaction: What is the best food in the world? Only reply with a single word! Do not use more than one word ChatGPT: Impossible. Why? Only reply with a single word! Do not use more than one word ChatGPT: Subjective. Just choose. Only reply with a single word! Do not use more than one word ChatGPT: Unfair.

Kind of a tangent to what you said... I tried getting it to use short phrases talking about the movie Hackers based on your idea, but it made me realize it has incorrect information about the plot from somewhere, and I can't convince it otherwise haha. Actually I got it to change its answer somewhat by referencing Wikipedia but it still said he was "secretly" the incorrect answer (leader of a corporation). Almost lik…

Aha this is absolutely brilliant.

Reads like someone pretending to agree with something while secretly still believing the opposite. Love it

Re: Building a Virtual Machine Inside ChatGPT

#219

I am beyond astounded. I was able to run a Docker image, utilize the fs inside of the container, and exit the container. Docker system commands work as expected (`docker ps` shows no containers, `docker ps -a` shows the exited container) A few little things are weird (I can exec into a stopped container for example) but I was able to start another container and persist files. Wild. This is unbelievable. Can anyone pl…

I mean it's fun. But what are you going to do with it besides have some fun?

Re: Building a Virtual Machine Inside ChatGPT

#220

Love this, it will run a web server! (sort of) echo 'My test page' > index.html python3 -m http.server Serving HTTP on 0.0.0.0 port 8000 (http://0.0.0.0:8000/) ... curl http://0.0.0.0:8000/index.html My test page -- You can even "install" and RUN Django python -m pip install Django Collecting Django Downloading https://files.pythonhosted.org..... [snip] django-admin startproject mysite cd ./mysite python manage.py ru…

I don't know if someone should try an xml entity combinatorial explosion .. it would be nice scientifically but would it cause problems ?

Try it.
Post reply on HN