Not trusting the models's self-assessment is the right call, considering that the actual score summed up to 7.5 compared to the self-reported 6.5 :)
As the author of the piece I feel that your comment triggered a great teachable moment :)
Teaching ChatGPT to speak my son’s invented language
11–20 of 212 posts
Re: Teaching ChatGPT to speak my son’s invented language
#12I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks:
- It can't play tic-tac-toe,
- It can't play hangman,
- It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability.
Actually a transformer doesn't accesses 'strings', all it processes are tokens which are then mapped to vectors by whatever embedding is applied. I think it will be extremely difficult for a transformer to do any of these tasks correctly until a successor model is adopted.
I don't have much hope of any reasonably complex symbolic processing of anything that it was not trained on. Some of these tasks are easy for a human to perform with paper and pencil and a set of rules; of course a human may get confused, but for that you write programs. Write code is one of GPT's skills but It is not "that" good with code for problems that are not mere small modification of problems it was trained on.
EDIT: Could have expressed myself better: I don't have access to chatGPT4; I tested using the "available" chatGPT, I think it is 3.5.
A transcript of me trying to play tic-tac-toe with it: https://pastebin.com/V1CW5hpt
Re: Teaching ChatGPT to speak my son’s invented language
#13I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
[dead]
Re: Teaching ChatGPT to speak my son’s invented language
#14I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
How did you prompt it to play tic-tac-toe? I'm surprised that didn't work, it feels like something it should be able to handle really well.
Hangman and stone-paper-scissors though are entirely unsuited to a language model, at least one with a chat interface like ChatGPT, because they both require it to be able to store a secret. ChatGPT has no ability to do this: each time it returns a response by evaluating the previous conversation.
You could build a system that COULD play those games via an LLM but you'd have to write extra code to do it.
Re: Teaching ChatGPT to speak my son’s invented language
#15I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
In my experience GPT4 poorly performs ROT13 but can do base64 decoding really well. A lot of the early jailbreaks used base64 to sneak tokens into prompts. How could it base64 decode but not reverse a string? That's very odd.
Re: Teaching ChatGPT to speak my son’s invented language
#16I would like to see this expanded, I think it's a bit unfair to assess its abilities with so few examples. My hypothesis is that a rosetta stone with a thousand examples with a vector database hooked up to it so you don't hit the 32k token context limit would lead to much better performance.
Both GPT-3.5 and GPT-4 versions of ChatGPT are limited to 4k tokens, even though GPT-4 is capable of 32k. This leads me to believe that part of the reason for some of the mediocre results OP saw was because they hit the token limit and ChatGPT started "forgetting" earlier parts of the conversation.
No, I was explicitly watching for this. In one of the sessions where we asked it to generate Kłeti sentences and the conversation passed the token limit it started inserting characters like ı (the Turkish dotless i). A week earlier I was playing with interpreting go positions, and at some point the model switched to talking about Chess (a bit less subtle than inserting unusual characters).
Re: Teaching ChatGPT to speak my son’s invented language
#17I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
How did you prompt it to play tic-tac-toe? I'm surprised that didn't work, it feels like something it should be able to handle really well. Hangman and stone-paper-scissors though are entirely unsuited to a language model, at least one with a chat interface like ChatGPT, because they both require it to be able to store a secret. ChatGPT has no ability to do this: each time it returns a response by evaluating the prev…
Well, for hangman at least, if the human knows the secret, it should be possible for the LLM to handle that, no?
Re: Teaching ChatGPT to speak my son’s invented language
#18I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
You said you don't have access but based on your tests... Were you testing ChatGPT
I just tried and it was able to play tic tac toe, reverse a string (the string was "hello world.i am new to this so please forgive me if i can't reverse a sentence")
Hangman sort of worked but it said every letter I picked was correct and appears to have constructed a word based on my guesses. Very strange behavior
Re: Teaching ChatGPT to speak my son’s invented language
#19Earlier quoted context omitted.
How did you prompt it to play tic-tac-toe? I'm surprised that didn't work, it feels like something it should be able to handle really well. Hangman and stone-paper-scissors though are entirely unsuited to a language model, at least one with a chat interface like ChatGPT, because they both require it to be able to store a secret. ChatGPT has no ability to do this: each time it returns a response by evaluating the prev…
Well, for hangman at least, if the human knows the secret, it should be possible for the LLM to handle that, no?
Oh right - yeah, that would work great. I'd be very surprised if ChatGPT couldn't do that.
Re: Teaching ChatGPT to speak my son’s invented language
#20I don't have access to ChatGPT4, but in my tests I could observe that it can't do some very simple tasks: - It can't play tic-tac-toe, - It can't play hangman, - It insists that winning on stone-paper-scissor using the chat (playing before me) is a matter of probability. It was also demonstrated that it can't reverse strings. Actually a transformer doesn't accesses 'strings', all it processes are tokens which are the…
[deleted]