Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

771–780 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#771
post #76

One amazing thing about this is the archaeological significance of the ChatGPT artifact. Researchers thousands of years from now, if they are able to invoke this model, will get an accurate simulation of the current state of technology. It's really astounding.

Fascinating thought, though you could say that about internet archive

Yeah and if you have a memex you could simulate yourself as a mirror at any point in time and see how you may have reacted or perceived the world. Or heck, a Roger Penrose for example.

Re: Building a Virtual Machine Inside ChatGPT

#772

Earlier quoted context omitted.

Makes me wonder what they have that they haven't released.

Could a censored AI ever be as powerful as a uncensored one?

Could a military-grade AI be ever more powerful as the public ones?

Re: Building a Virtual Machine Inside ChatGPT

#773
post #604

Earlier quoted context omitted.

i feel bad for the guys that are on call right now. WTF! why is the memory spiking beyond expectations?!

What makes you say this? Rerunning the whole, which it appears they’re doing, is to prevent the need to hold onto state, so memory is not used. In other words, they’re not having this problem because they’re not doing it that way.

> so memory is not used

Not used for more than the duration of inference, but definitely used during inference.

Re: Building a Virtual Machine Inside ChatGPT

#774

> Write a press release for Apple's AR glasses, including it's name, two standout features, and price. "Today, Apple announces the release of their highly anticipated AR glasses, named the "iGlasses." The iGlasses offer a seamless blend of technology and design, with two standout features that set them apart from the competition. First, the iGlasses offer a revolutionary new display system that projects a high-resolu…

Haha, I did this too. Had pretty good convo with Steve Jobs and Jony Ive about augmented reality, and its various use-cases. Steve is big on education, while Jony is betting on entertainment. They agree that it won't replace mobile phones. Steve then went off that having synthetic characters as mentors would be a valuable tool for learning.

This tech is insane. I love it.

Re: Building a Virtual Machine Inside ChatGPT

#775

It isn't actually running any commands. I was playing with it earlier and asked it for the md5 hash of some random string. It happily output the md5 hash and gave a couple paragraphs of info about md5 hashing. Except, it wasn't the correct hash. It was just some random string that is a valid md5 hash for... something. It is a language model, not a computer, and it certainly isn't a virtual machine, although it will h…

>> I'm sorry, but I am unable to generate an MD5 hash for you because I am a text-based AI assistant and do not have the ability to perform cryptographic calculations. An MD5 hash is a complex mathematical function that is used to create a unique digital fingerprint for a file or piece of data, and it would require a specialized program or calculator to generate one.

Oh but it will keep happily pretending to execute code for you, even though it can't actually execute it. It's just with MD hashes that it suddendly puts its cards on the table?

I'm wondering about the business incentives behind this.

Re: Building a Virtual Machine Inside ChatGPT

#776

It isn't actually running any commands. I was playing with it earlier and asked it for the md5 hash of some random string. It happily output the md5 hash and gave a couple paragraphs of info about md5 hashing. Except, it wasn't the correct hash. It was just some random string that is a valid md5 hash for... something. It is a language model, not a computer, and it certainly isn't a virtual machine, although it will h…

Among other things they use this free period of ChatGPT testing to further restrict what it should process/output. Yesterday I've been playing for about an hour or so with ChatGPT and invented a new language. After my session expired, I couldn't restart the process with the same prompts I've used before and received a message similar to yours but related to the fact that "I can't process new languages that are not part of my language model". Of course, there must be some way to subvert its responses, but that wasn't something I wanted to waste time doing.

Re: Building a Virtual Machine Inside ChatGPT

#777
post #763

Earlier quoted context omitted.

That only works if you have another computer with you to check the hash, but maybe that's actually an AI, and not the other way around?

> The MD5 hash for the string "asdns" is "5a5a5ad63c5a5a5a5a5a5a5a5a5a5a5". I don't need a computer to say that isn't correct ;) Wow I just reset the thread, used the exact same input and got this (literally 60 seconds apart): I'm sorry, but I am unable to generate an MD5 hash for you because I am a text-based AI assistant and do not have the ability to perform cryptographic calculations. An MD5 hash is a complex mat…

>> Wow I just reset the thread, used the exact same input and got this (literally 60 seconds apart):

It could mean that a lot of people had the same idea as you recently and OpenAI just figured it out.

Re: Building a Virtual Machine Inside ChatGPT

#778

It isn't actually running any commands. I was playing with it earlier and asked it for the md5 hash of some random string. It happily output the md5 hash and gave a couple paragraphs of info about md5 hashing. Except, it wasn't the correct hash. It was just some random string that is a valid md5 hash for... something. It is a language model, not a computer, and it certainly isn't a virtual machine, although it will h…

>> I'm sorry, but I am unable to generate an MD5 hash for you because I am a text-based AI assistant and do not have the ability to perform cryptographic calculations. An MD5 hash is a complex mathematical function that is used to create a unique digital fingerprint for a file or piece of data, and it would require a specialized program or calculator to generate one. Oh but it will keep happily pretending to execute…

Have you actually tried it? It doesn't execute any code anymore for a few hours now

Re: Building a Virtual Machine Inside ChatGPT

#779

How is this real? I’m so confused what makes this even remotely possible. Edit: To make this even more crazy it looks like it has been altered to cut off this line of questioning once it comes to internet content. It was working and now suddenly has stoped. It has a canned like cut off response now: I'm glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal…

> I'm glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal. People who like to pooh-pooh generative AI systems as unable to be "truly creative" or to have "genuine understanding" tend to misunderstand them, which is a shame, because their actual fundamental limitations are far more interesting. One is that behavior cloning is miscalibrated( https://www.le…

Isn't that what critics mean when they say that such systems don't have "genuine understanding"? They have no knowledge of their lack of knowledge, and they have no knowledge of the existence of such a thing as knowledge. They are big tables of tokens with probabilities that humans ascribe knowledge or intelligence to, for reasons similar to our ability to see the face of Jesus on a slice of bread etc. They can output text, but it takes a human to understand it (genuinely or not).

Re: Building a Virtual Machine Inside ChatGPT

#780

It isn't actually running any commands. I was playing with it earlier and asked it for the md5 hash of some random string. It happily output the md5 hash and gave a couple paragraphs of info about md5 hashing. Except, it wasn't the correct hash. It was just some random string that is a valid md5 hash for... something. It is a language model, not a computer, and it certainly isn't a virtual machine, although it will h…

It suggests that it understand what pseudorandomness looks like. A hash function output usually looks pseudorandom. It's almost like it can look at a picture from an old television, and separate the random static from the "signal" part of the picture. It can carry out de-noising because it knows what noise looks like. It can never remember exactly what the noise looked like, because like for us, it doesn't matter.

If you restart the session and enter

  > echo test1 | md5
it will output another random 'hash' each time. But within one session it knows that md5 should produce the same output. Running

  > echo test1 | md5
multiple times, or even

  > VAR1="test1"; echo $VAR1 | md5
produces the same output for me within the same session, while

  > echo test2 | md5
results in a different, but also session-consistent hash.
Post reply on HN