[deleted]
I Taught ChatGPT to Invent a Language
121–130 of 250 posts
Re: I Taught ChatGPT to Invent a Language
#122Earlier quoted context omitted.
ChatGPT's superpower is hijacking the human desire for meaning into causing people to believe it is much better than it really is. https://en.wikipedia.org/wiki/G%C3%B6del,_Escher,_Bach has dialogues between Achilles and the Tortoise where they work out the limitations of various fantastic A.I. systems based on mathematical logic. Roughly, neural networks don't repeal the results of Gödel, Turing and Tarski. The shor…
I’ve been using it to teach me programming languages. If it plateaus here I’m delighted by its uniqueness and utility. You seem to think people are hinting this is general ai. I don’t think that’s what’s amazing people. I’ll bet you Siri and Alexa would be 100x more useful with a language model like this behind it. Part of their uselessness is the inability to generalize or reason, but relying instead in coded prompt…
[deleted]
Re: I Taught ChatGPT to Invent a Language
#123As a committed conlanger (but not a good one: I didn't land the Dothraki contract), I read this article with some trepidation. Is my weird little hobby soon to fall victim to the oncoming AI tsunami? After the read, I find myself pleasantly surprised. My initial suspicion that the language would turn out to be Just Another Relex (make a new language by replacing English words with invented words, keeping the grammar…
Why isn't this a relex? As an interested casual linguistics observer, that's what it looks like to me. Is it just because the nouns are inflected?
Easiest reason is the 'introduction particle', blub which we don't have in English, for subordinate clauses.
I think 'taught ChatGPT to invent a' is hyperbolic though, this is more like 'taught ChatGPT my invented' - the only thing it invents itself are the 'relex' word->word mappings.
Re: I Taught ChatGPT to Invent a Language
#124I see posts like this and don't understand how they are made. I asked chatGPT this morning if it "remembered" something I asked in the previous prompt, and it said something to the tune of "I am simply a NLP machine learning model, I provide a decent output for good inputs, I don't have a sense of context, memory, or time." That's why I really don't understand these contextualized multi step conversations. Especially…
I asked it to simulate a Chess engine and it gave the usual "I am a blah blah blah, I cannot blah blah blah, because blah blah." I clicked "Try Again" and it worked.
Is it any good?
Re: I Taught ChatGPT to Invent a Language
#125Earlier quoted context omitted.
> some of these gaps can be tackled Seems like the major gap is in facts. It'll often make up completely plausible specific details that are flat wrong, or refuse to proceed if it's "not allowed" to do so. Coupling it (handwave) with a massive structured data repository like Wolfram Alpha and Wikidata would be really something.
I find the guard rails they put in maddening and weirdly implemented. I wanted it to make up jokes for me and it’s jokes are the same few over and over. (I can never remember jokes so this is a super useful tool for me!) so I wanted it to tell me jokes in the style of Jerry Seinfeld. The guard rails prevented it from doing that because he’s a real person and it tries to not bend its personality pretty hard. However b…
Indexing Wikipedia (or any) text is a statistical thing though. When you ask a specific question like the size of a car, say, it will often come back with a compelling number in context, but if you actually look it up, it's usually not quite right.
Another example is that it can just "invent" new functions when coming up with code snippets. Syntactically usually correct and completely plausible in the context, but simply doesn't exist.
I also am pretty baffled by the limitations. I just assume they're trying to avoid "scammers use AI to construct false financial documents" type of furores in the early days (once the market is saturated with competition, blame will be too diffuse to stick) and convincing customers of their proprietary systems that they won't end up with a customer support bot that starts reciting racial slurs.
Re: I Taught ChatGPT to Invent a Language
#126As a committed conlanger (but not a good one: I didn't land the Dothraki contract), I read this article with some trepidation. Is my weird little hobby soon to fall victim to the oncoming AI tsunami? After the read, I find myself pleasantly surprised. My initial suspicion that the language would turn out to be Just Another Relex (make a new language by replacing English words with invented words, keeping the grammar…
You told chatgpt to write this comment, didn't you.
Re: I Taught ChatGPT to Invent a Language
#127Paywall.
Re: I Taught ChatGPT to Invent a Language
#128Earlier quoted context omitted.
Pretty sure it gets the entire conversation as input
Is this described somewhere? Wikipedia doesn't help
It feeds the entire previous conversation back into the AI until it reaches the token limit. This isn't a new technique; the first place I saw it was in AI Dungeon (an AI writing/adventure app) back on GPT-2. NovelAI, another writing app, has some interesting tweaks to keep a consistent story, like a "lorebook" to associate words with descriptions, which it then swaps into the input when those words come up so the AI can "remember" farther back. I wouldn't be surprised if ChatGPT has some automated version of this in addition to the naive rolling feedback.
Re: I Taught ChatGPT to Invent a Language
#129As a committed conlanger (but not a good one: I didn't land the Dothraki contract), I read this article with some trepidation. Is my weird little hobby soon to fall victim to the oncoming AI tsunami? After the read, I find myself pleasantly surprised. My initial suspicion that the language would turn out to be Just Another Relex (make a new language by replacing English words with invented words, keeping the grammar…
You told chatgpt to write this comment, didn't you.
Tempting, but no. I'm too busy failing at Advent of Code to start playing with chatgpt today.
Re: I Taught ChatGPT to Invent a Language
#130This would be fun to use to invent a programming language.