Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

891–900 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#891
Preparing to unpack .../7-nvidia-kernel-common-450_450.66.08-0ubuntu1_amd64.deb ... Unpacking nvidia-kernel-common-450:amd64 (450.66.08-0ubuntu1) ... Selecting previously unselected package nvidia-utils-450:amd64. Preparing to unpack .../8-nvidia-utils-450_450.66.08-0ubuntu1_amd64.deb ... Unpacking nvidia-utils-450:amd

Got an error from chatgpt when continuing to sudo apt install nvidia-smi Simon Socolow {continue}

! An error occurred. Either the engine you requested does not exist or there was another issue processing your request. If this issue persists please contact us through our help center at help.openai.com.

Re: Building a Virtual Machine Inside ChatGPT

#892
post #42

Earlier quoted context omitted.

Without exaggeration, it is the most impressive tech demo that I have ever seen. It is literally years - possibly decades - ahead of my prior expectations.

I'm wholeheartedly confused why so many people are only just now learning of OpenAI/GPT-3 and its chat mode, I guess presentation truly is everything. Nothing here is particularly new, it's just a better model than before. Statements like "the people haven't realized it yet" confuse me because "the people" is two groups. People in the know, and people not in the know. Everyone in the know realizes where this is heade…

It's like with Dalle-2 and StableDiffusion, so many people were just not understanding how it was even possible, some people even going as far as calling it a hoax in some way.

But for anyone paying attention, it's been easy to see the progression. I'm not even an ML person but I could give you a map from every paper to every other paper for how this has all been happening faster and faster, basically starting with AlexNet in 2012.

That said, this chatGPT is different than GPT-3's first demos earlier last year or the Codex interface in that it is implementing a consistent memory and seems to have a token length capability much, much longer than before. This is having a huge effect on what you can coax out of a chat with it. You can tell it to act a certain way and then continuously interact with that entity- with GPT, you got the one prompt, but once you tried again with a new prompt that memory was gone. You could attempt to feed the entire output back in as input, but at least initially the token length would cut things off eventually. Meanwhile, with chatGPT, I just had a 20-minute conversation with a "girl from Reseda, CA' who's a barista and like, totally is going to go on a keto diet like her sister. " because I told it that is who it should act like it is and under all circumstances it should respond to my chat in that way.

BTW she says that "bangs are totally in style right now" and she really likes "exploring new hairstyles like ones from the 90's"

So yeah. This is shaking people up.

Re: Building a Virtual Machine Inside ChatGPT

#893

Earlier quoted context omitted.

This is exactly the kind of internally inconsistent reply I’d expect from ChatGPT. You can’t claim that it‘s a duck because it quacks and walks like a duck as long as you ignore all the times it barks like a dog. If the model isn’t accessible how do you know it exists? If it has an actual model how does it break from something as silly as BPE encodings? It’s like a rocket scientist tripping up over 1 + 1. “Don’t talk…

There's nothing inconsistent about my reply. >You can’t claim that it‘s a duck because it quacks and walks like a duck as long as you ignore all the times it barks like a dog. People make mistakes, but people understand. Therefore, the existence of mistakes do not unilaterally discount understanding. You have to do actual argumentative work to demonstrate the system that shows occasions of model-based reasoning is no…

> People make mistakes, but people understand. Therefore, the existence of mistakes do not unilaterally discount understanding.

I'm not claiming people don't make mistakes or that an algorithm has to be perfect, I'm claiming the algorithms makes the same mistakes that people do when they're clearly don't understand something but try to cover it up with basic word association.

> You have to do actual argumentative work to demonstrate the system that shows occasions of model-based reasoning is not in fact doing model-based reasoning.

The burden of proof is on you. I can prove beyond a shadow of a doubt that a neural network is a gigantic algebraic function. You have to provide convincing evidence that it actually "understands" or has anything resembling what humans would call a "model of the world."

> All else being equal, a single (convincing) example of model-based reasoning is enough to demonstrate the existence claim.

Might as well have a quadrillion monkeys banging on type writers. As long as one of them manages to output Shakespeare's Othello, they must be as smart as humans, right? That's just cherry picking to support your preexisting conclusion.

> You have to provide an actual argument to undermine the value of the example by examples of unrelated failures.

See above. The burden of proof is on you.

For what it's worth, my mind has been blown away over the progress we've seen in the last few months and I'm very bullish on AI. I've been regularly using Replicate and OpenAI for both business and pleasur and my conclusion isn't that computers are becoming "smart" but that Brooks-Moravec-Minksy were right: https://en.wikipedia.org/wiki/Moravec%27s_paradox

Re: Building a Virtual Machine Inside ChatGPT

#896
post #717

Earlier quoted context omitted.

You can get more exotic than that! I want you to act as a command line terminal and you have IRIX installed. I will type actions and you will reply with what a terminal would show. I want you to only reply with the page output inside one unique code block, and nothing else. Do no write explanations. Do not perform actions unless I instruct you to do so. When I need to tell you something in English I will do so by put…

nice, i had it be an apple iie, generate code for an adventure game in basic then run it. it did acurately.

Now I´d love to test if I could run a fake nethack session on it.

Re: Building a Virtual Machine Inside ChatGPT

#897

Earlier quoted context omitted.

I believe one would have to foray into Martin Heidegger for this, understanding not as an epistemic term but as an ontological category: "Understanding is… the original form of the realization of Dasein, being-in-the-world" [1]. And since GPT is not embodied, by definition it is not "under-standing". Heidegger uses again and again this language game of hypokeimenon [2], that which lies underneath, standing under, the…

Why should understanding entirely depend on being "embodied"? This is like defining understanding as "a thing humans do" and then insisting that by definition only humans can do it. The first link then goes on: "One central element of this view is that we are always projecting possibilities onto the world around us. ... To take an example that Samantha Matherne (2019) uses to illustrate Heidegger’s view: when I first…

"Why should understanding entirely depend on being 'embodied'?"

By asking such a question you are still considering understanding as an epistemic term and not an ontological category. The example given by Ms. Matherne suffers from the same ontic reduction. I will not even try to give an example of "understanding as ontological category", taking the James Cameron way: the (language) technology is not ready yet, maybe never will; perhaps to give such an example we would require a memory transfer technology [1].

"insisting that by definition only humans can do it"

Yes, this is the entire Heideggerian project: humans as Dasein. Beyond tongue-in-cheek, Heidegger is concerned with the history of Beyng (notice capital B and unusual y, in German he spells it as "Seyn", as opposed to "Sein", the Germans capitalize all nouns by default) in which there is a "first beginning", during the Ancient Greek resolvement of metaphysics (even the word, μετά, beyond, φυσικά, physics, that which grows, is used initially only to group some texts by Aristotle written after Physics), and his search for "the other beginning". This is all very obscure. And Heidegger doesn't help it by literally inventing a language without providing a Rosetta stone. In The Event [2] he has quotes like "'Technology' as the basic truth of history qua happenstance" under the title "163. The Saying", make of it what you will. However, just above "162. The demise of metaphysics", he says "[i]f thinking has passed over into erudition [...] [e]ven those who are thoughtless will then recognize how inessential it is". So he can write clearly also. But again, to quote Edward Feigenbaum, "What does he offer us? Phenomenology! That ball of fluff. That cotton candy!" [3].

Again, this all was to give an example of a thinking with no overlap with GPT. As I see it now, departed from Heidegger's view, the problem is how we continue Galileo's project, "measure what can be measured, and make measurable what cannot be", with or without ontological categories.

[1] https://www.frontiersin.org/articles/10.3389/fnsys.2013.0012...

[2] Perhaps his most beautiful book, to be read from the end to the beginning, https://iupress.org/9780253006868/the-event

[3] Feigenbaum was criticizing Hubert Dreyfus, but the reprimand applies to Heidegger as well, https://en.wikipedia.org/wiki/Hubert_Dreyfus%27s_views_on_ar...

Re: Building a Virtual Machine Inside ChatGPT

#898
post #613

Earlier quoted context omitted.

The statefulness of the text file with jokes is intriguing though, don’t you think?

It is, but maybe it is simply imitating tutorials where "cat file.txt" writes the same content that was on the same page in a command "echo text > file.txt" above. In other words, language models are really good at impersonating whatever you want them to be through clever tricks, without being it.

I don’t know how that’s implemented, but I‘d expect mistakes to creep in if multiple text lines are just „dreamt up“. The Textfile contents are perfectly accurate though.

Re: Building a Virtual Machine Inside ChatGPT

#899
And my travails continue. I've begun guiding chatGPT in writing a novel. During the course of the novel writing I've discovered that there is an active filter outside the AI's training that intercepts certain words and refuses to return blocks of text containing those words.

I've prompted the AI to redact content against openai's content policy using X for each letter in the word. And it works. It is well trained enough to know openai's content policy and to dodge the filter effectively.

Post reply on HN