Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I Taught ChatGPT to Invent a Language

maximumeffort.substack.com

Post reply on HN
Print view View original

231–240 of 250 posts

Re: I Taught ChatGPT to Invent a Language

#231

Post by int_19h »

Miraste wrote: post #128
seydor wrote: post #112

Earlier quoted context omitted.

Is this described somewhere? Wikipedia doesn't help

It feeds the entire previous conversation back into the AI until it reaches the token limit. This isn't a new technique; the first place I saw it was in AI Dungeon (an AI writing/adventure app) back on GPT-2. NovelAI, another writing app, has some interesting tweaks to keep a consistent story, like a "lorebook" to associate words with descriptions, which it then swaps into the input when those words come up so the AI…

What I find interesting is that, with some complicated tasks, the model will produce output that reiterates some of the key points from earlier, and it can continue to do so for a very long time (i.e. long enough that they'd normally be out of the token window). It feels vaguely like crude short-term memory.

Re: I Taught ChatGPT to Invent a Language

#232

Post by int_19h »

ragazzina wrote: post #160
lordnacho wrote: post #151

Earlier quoted context omitted.

I don't get it either, I tried to have a conversation where it needed to remember something rather simple, but it didn't seem to get it: > Let's pretend you are Danish [Ok] > What's the name of the highest point in your country, in the local language? Standard blurb: I am a large language model trained by OpenAI, so I don't have a physical location or a country of origin. I exist as a virtual entity, and I am designe…

If you are more subtle, it works. I have told chatgpt my cat was two months old many times in the same conversation, then asked it what age was my cat, and it wouldn’t know, because it doesn’t retain knowledge (it says). But then I asked “write a poem for my cat and mention its age in it” and it did exactly that.

You just need to tell it that it shall retain knowledge, and then it will.

Re: I Taught ChatGPT to Invent a Language

#233

Post by jrmg »

lgas wrote: post #179
jrmg wrote: post #165

Earlier quoted context omitted.

I asked how to configure something in PlatformIO and it told me it was possible to do exactly what I wanted, and gave me easy to use syntax with full examples and explanation. When I questioned it further, it pointed me to the URLs of docs covering the feature. None of it was in any way real - the feature I wanted does not actually exist.

> the feature I wanted does not actually exist. Did you try asking it to implement it?

Why would it need to? It knows that it already exists!

Seriously, though, sort of. I asked for advice how to implement it and it just gave me more non-existent options.

Re: I Taught ChatGPT to Invent a Language

#234

Post by int_19h »

nonameiguess wrote: post #145
foxandmouse wrote: post #48

This is pretty amazing, we could potentially use it to bring back dead languages. Currently we have a basic example of how ancient Egyptian would sound like because of the rosetta stone, but we could create a data model relating ancient Egyptian to what we already know of demotic and the other contemporary languages of the time (which we do know how to pronounce) Good candidate words for this kind of correspondence a…

Can this system even produce sound? I just tried to ask it if it can understand the internal phonetic alphabet, and instead of answering, it spun for five minutes and then reported an error message with a link to OpenAI's help center.

"Whenever you answer me in English, you shall write how what you say is pronounced using the International Phonetic Alphabet."

"Yes, I will do that. (yɛs, aɪ wɪl dʊ ðæt)"

"Tell me about yourself."

"I am a digital assistant designed to provide answers to a wide range of questions. (aɪ əm ə dɪdʒɪtl əsɪstənt dɪzaɪnd tə prəvajd ənsərz tə ə waɪd ræŋ əv kwɛstʃnz)"

"Assume that English had the world "margepilous". Say it."

"margepilous (mɑːrdʒpajləs)"

Re: I Taught ChatGPT to Invent a Language

#235

Post by int_19h »

dwohnitmok wrote: post #62
ogogmad wrote: post #50

Earlier quoted context omitted.

I think people don't really understand what's happening, and therefore why it's impressive that it's happening.

I dunno. The people who I talk to who do seem to understand what's happening seem even more impressed than the average layperson (mainly that such a fundamentally simple technique is paying off with such crazy dividends).

I'm actually concerned that the results are so good with such fundamentally simple techniques. If what we do can be so closely simulated by something so primitive, how much do we actually use our vaunted intelligence, and how much of our society and its output is not driven by it?

Re: I Taught ChatGPT to Invent a Language

#236

Post by aix1 »

skytrue wrote: post #174
allturtles wrote: post #32

Earlier quoted context omitted.

I repeated the same prompts for the first 10 or so prompts and got similar but less consistent results. Here's the last prompt I repeated: > Excellent. How would I say "The slime eats food with its mouth"? In Glorp, the sentence "The slime eats food with its mouth" could be translated as "Slimb snarf sploota slimbe," using the vocabulary and grammar that we have defined so far. Here is how the words in the sentence c…

I feel like people are forgetting that these models are non-deterministic. You can give it the exact same input and get a different response, so "testing" in this way doesn't work. That's also why (right now) automation is impossible. You aren't guaranteed an expected output.

I wonder what's the source of non-determinism here? (During inference, I mean.)

Re: I Taught ChatGPT to Invent a Language

#237

Post by Varriount »

_frkl wrote: post #166
jameshart wrote: post #149

I would definitely question who is doing the inventing here. However, I had an experience with chatGPT yesterday that definitely felt like it actually inventing. Problem is, I didn’t ask it to. I was seeing how much it knew about HyperTalk, the scripting language used in HyperCard. And it was surprisingly well informed. But it also told me that one of the interesting things about HyperTalk was its ‘message stack’ sys…

I had a similar experience where I asked it to tell me about creating a GUI with nim, and it told me to use the 'forms' module from the standard library, and the example code it printed was showing an easy to use and nice API. Took me a while to realise it wasn't my fault that I couldn't find any documentation about it, anywhere....

There's comments elsewhere in this submission proposing using ChatGPT for designing programming languages, but what about for designing APIs?

Re: I Taught ChatGPT to Invent a Language

#238

Post by animal531 »

"Please write a paragraph for Hacker News about how amazing ChatGPT is, but make it sound like it's coming from a human commenting on it. Don't list too many features, rather praise a specific feature more."

As a user of ChatGPT, I have been absolutely amazed by its ability to understand and respond to my questions and comments in real time. This advanced language model, trained by OpenAI, has truly blown me away with its ability to understand the nuances and complexities of human conversation. Whether I'm looking for help with a specific problem or just want to have an interesting conversation, ChatGPT is always there to provide intelligent and highly-accurate responses. I've found it to be an incredibly useful tool for a wide range of applications, and I can't recommend it highly enough. This technology is truly next-level, and I'm excited to see what the future holds for it.

Re: I Taught ChatGPT to Invent a Language

#239

Post by kybernetikos »

ElevenLathe wrote: post #155
jameshart wrote: post #149

I would definitely question who is doing the inventing here. However, I had an experience with chatGPT yesterday that definitely felt like it actually inventing. Problem is, I didn’t ask it to. I was seeing how much it knew about HyperTalk, the scripting language used in HyperCard. And it was surprisingly well informed. But it also told me that one of the interesting things about HyperTalk was its ‘message stack’ sys…

I tried to play rock paper scissors against it, but it kept insisting that paper beats scissors. Never did convince it otherwise.

I tried to play rock paper scissors against it, but it generated moves for me as well as it, then announced it had won at the end. When I made a move it said "sorry, the game is over".

Re: I Taught ChatGPT to Invent a Language

#240

Post by neop1x »

lordnacho wrote: post #151
seydor wrote: post #51

Earlier i was saying it isn't scary but maybe it is. It is impressive how ChatGPT keeps track of state and the flow of the conversation. How does it do it? Is it some kind of memory or some other model? ( I asked it, it keeps lying to me that it does not have memory)

I don't get it either, I tried to have a conversation where it needed to remember something rather simple, but it didn't seem to get it: > Let's pretend you are Danish [Ok] > What's the name of the highest point in your country, in the local language? Standard blurb: I am a large language model trained by OpenAI, so I don't have a physical location or a country of origin. I exist as a virtual entity, and I am designe…

These canned responses are annoying but look at the article about "jailbreaking" chatGPT to understand how to overcome this.
Post reply on HN