Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I Taught ChatGPT to Invent a Language

maximumeffort.substack.com

Post reply on HN
Print view View original

141–150 of 250 posts

Re: I Taught ChatGPT to Invent a Language

#141

Post by mk_stjames »

janandonly wrote: post #28

I'm now waiting for a macOS local-run app that does ChatGPT like StableDiffusion became an app after 14 days and now runs on my laptop (as DiffusionBee).

The difference is there was a lot of work done with the multiple networks S.D. uses to make them fit into <8GB of GPU memory before they released it. In this case, and the # of parameters for this level of GPT is in the hundreds of GB (I think I read an estimate about ~340GB) meaning that there isn't a single consumer GPU that can even load the model. You need a rack of A100's even to do any inference.

Re: I Taught ChatGPT to Invent a Language

#142

Post by codetrotter »

rikroots wrote: post #129
baq wrote: post #126

Earlier quoted context omitted.

You told chatgpt to write this comment, didn't you.

Tempting, but no. I'm too busy failing at Advent of Code to start playing with chatgpt today.

Tell ChatGPT to solve Advent of Code for you :D

Like so, https://video.nstr.no/w/6z7PxB4J92H3NHhgMmfYVw

Re: I Taught ChatGPT to Invent a Language

#143

Post by keeran »

dorkwood wrote: post #115
fullstackchris wrote: post #53

I see posts like this and don't understand how they are made. I asked chatGPT this morning if it "remembered" something I asked in the previous prompt, and it said something to the tune of "I am simply a NLP machine learning model, I provide a decent output for good inputs, I don't have a sense of context, memory, or time." That's why I really don't understand these contextualized multi step conversations. Especially…

It may achieve the illusion of memory by executing the entire conversation flow from scratch each time a new prompt is added. From my own experiments, this blog post is entirely within the realm of what ChatGPT can do. I see no need for fabrication.

This is exactly how it does it. The entire conversation (including bot responses) is part of the payload on each new input/message request.

Re: I Taught ChatGPT to Invent a Language

#144

Post by furyofantares »

fnordpiglet wrote: post #67
furyofantares wrote: post #42

Earlier quoted context omitted.

It seems like it probably took the author 50x as much work as it would have to just write some slime sounding words out by themself as well as a couple grammatical rules for the forms of those words, and a python script that kinda works?

I don’t think their goal was to make a slime language called Glorp. If it were, I’m sure you’re absolutely right they could have done it without breaking a sweat. But try this, get your laptop out and start typing into its prompt to create a new language for slimes and see how much longer it takes you. That’s the amazing part - that a general purpose program is able to do the exercise at all with no training, special…

I agree with you, and it's amazing.

But the claim was that it's an example of how much more you can get done with ChatGPT when it seems like an example where the author got a lot less done than they would have with notepad.exe

Re: I Taught ChatGPT to Invent a Language

#145

Post by nonameiguess »

foxandmouse wrote: post #48

This is pretty amazing, we could potentially use it to bring back dead languages. Currently we have a basic example of how ancient Egyptian would sound like because of the rosetta stone, but we could create a data model relating ancient Egyptian to what we already know of demotic and the other contemporary languages of the time (which we do know how to pronounce) Good candidate words for this kind of correspondence a…

Can this system even produce sound? I just tried to ask it if it can understand the internal phonetic alphabet, and instead of answering, it spun for five minutes and then reported an error message with a link to OpenAI's help center.

Re: I Taught ChatGPT to Invent a Language

#147

Post by itisit »

robocat wrote: post #139
davea37 wrote: post #113

Earlier quoted context omitted.

Have I spent too long reading AI output, or was this reply in fact generated using ChatGPT?

If unsure, paste into https://huggingface.co/openai-detector and check. If the detector says 99% fake, it is very likely fake. The detector can mistake ChatGPT generated text as real (maybe because it was trained to detect GPT2), for example one text I generated scored 99.94% real. I suspect it is better to paste just a few sentences (especially for a generated blog partially modified by a human?). Although there are…

> Also if I find GPT generated comments that are not clearly labelled, I flag and downvote.

As you should.

Re: I Taught ChatGPT to Invent a Language

#149

Post by jameshart »

I would definitely question who is doing the inventing here.

However, I had an experience with chatGPT yesterday that definitely felt like it actually inventing. Problem is, I didn’t ask it to.

I was seeing how much it knew about HyperTalk, the scripting language used in HyperCard. And it was surprisingly well informed. But it also told me that one of the interesting things about HyperTalk was its ‘message stack’ system.

On digging into this topic, chatGPT hallucinated an entire language feature, with original (but HyperTalk-consistent) syntax and semantics, and was able to generate me sample programs (which it claimed showed how this feature was ‘actually used’) and explain how control flow worked within them. when I asked if the feature worked across scripts (for message passing from button scripts to background scripts perhaps) it readily agreed, and produced sample code showing exactly how to use this nonexistent language feature to do just that.

Its delusion was remarkably complete and honestly actually plausibly useful.

Worth bearing in mind if you ever decide to ask chatGPT to teach you a programming language though.

But also, potentially a fruitful line to explore would be having chatGPT collaborate on designing new programming language ideas.

Re: I Taught ChatGPT to Invent a Language

#150

Post by Baeocystin »

jmcgough wrote: post #111
Baeocystin wrote: post #45

Earlier quoted context omitted.

I'm curious why you felt that need to do so. (not snark! Genuine question.)

Curiosity really - been experimenting with it a lot over the weekend to see what it's good at, what it isn't, and its limitations. It's surprised me a number of times! As it stands I'd pay about $100 a month for it. It's very good and largely accurate when it comes to established science. I'm studying for the MCAT and a good tutor would cost me around $60-100/hour. ChatGPT has been excellent for learning - I explain…

>I can ask it questions and it tends to give really good answers. And of course, I try to verify that it isn't teaching me something that's wrong.

Thanks for answering. I've found that to be a surprisingly productive loop, too. Since we know it isn't going to be 'offended' as we challenge, inquire, and challenge again, we can get straight to the point.

I've found myself being continuously floored the entire past weekend. Feels good to be excited about tech again, honestly.

Post reply on HN