What exactly are people expecting? All transformer models, of which ChatGPT is just one big fancy example, are just pattern matchers based on a large corpus of text trying to find the next string that completes the pattern. There's no reasoning, no understanding. It's just a big fancy parrot. Now ask your parrot to do some math. Polly want an AI cracker? We clearly haven't cracked the code on AGI yet, and transformer…
ChatGPT, Rot13, and Daniel Kahneman
191–200 of 213 posts
Re: ChatGPT, Rot13, and Daniel Kahneman
#192Re: ChatGPT, Rot13, and Daniel Kahneman
#193I first tried it with just one word (pebff) but it forgot the final s. But it did great with the whole sentence!
---ME---
Yes, please decode the following message: "Jul qvq gur puvpxra pebff gur ebnq?"
---CHATGPT---
To decode the message "Jul qvq gur puvpxra pebff gur ebnq?", we can follow the steps you outlined earlier:
First, separate each letter on its own line:
J
u
l
q
v
q
g
u
r
p
u
v
p
x
r
a
p
e
b
f
f
g
u
r
e
b
n
q
Then find the ROT13 equivalent of each letter:
J -> W
u -> h
l -> y
q -> d
v -> i
q -> d
g -> t
u -> h
r -> e
p -> c
u -> h
v -> i
p -> c
x -> k
r -> e
a -> n
p -> c
e -> r
b -> o
f -> s
f -> s
g -> t
u -> h
r -> e
e -> r
b -> o
n -> a
q -> d
Next, get just the second letter on each line:
W
h
y
d
i
d
t
h
e
c
h
i
c
k
e
n
c
r
o
s
s
t
h
e
r
o
a
d
Finally, put all the new letters together into a word:
Why did the chicken cross the road?
So, the decoded message for "Jul qvq gur puvpxra pebff gur ebnq?" is "Why did the chicken cross the road?"Re: ChatGPT, Rot13, and Daniel Kahneman
#194Earlier quoted context omitted.
This is not it or not sufficient explanation. chatGPT is able to read text with letters purposefully scrambled. Like those texts that show how humans have an innate ability to read text with letters misplaced. chatGPT can understand the text, figure out what is going on and produce text of the same type. I tried it, precisely to understand if it was working with words as its token. Interestingly, it cannot produce te…
Did you try entering one of those scrambled sentences into the tokenizer? It's not tokenizing words exactly- the doc says roughly ~100 tokens => 75 words.
Re: ChatGPT, Rot13, and Daniel Kahneman
#195I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. That is the opposite of what many people, including me, have come to expect of computers. I have worked for many years in translation, lexicography, and language education, and I am flabbergasted at how well ChatGPT handles natural language. It can produce example sentences of po…
> I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. All this time developers have been freaking out about ChatGPT taking their jobs when it's really politicians that should be nervous!
Re: ChatGPT, Rot13, and Daniel Kahneman
#196Earlier quoted context omitted.
This will sound trite, but I wonder whether there's a lesson here to be learned about human education. We put a great deal of effort into educating our children in language and math, to the extent that those form the major branches of our standardized testing for college admissions tests (where they are still used). We treat them as separate subjects, perhaps for good reason, as we also do science and geography and a…
That doesn’t sound trite to me at all. ChatGTP raises major issues for the future of education in many areas, and discussions about how to deal with them have just begun.
Re: ChatGPT, Rot13, and Daniel Kahneman
#197Earlier quoted context omitted.
It's just a guy talking. > Plus from the video: "do you have a thorough idea what OpenAI is doing, neither do I" - cut to strobe light and rock music. Jeesh, can't see that as support. The hell are you talking about? There's no strobe there, he just goes to a slide with a white background, and the music is very quiet compared to his voice and not at all something I would call "rock".
> It's just a guy talking. Maybe joe_the_user went overboard with calling it strobe light, but this is definitely not "just a guy talking". I don't know how people call this style of videos but it's very tiresome - constantly zooming in and out, full of sound effects (glass breaking, snaring, what not), changing backgrounds, changing lights, everything is just uncontrollably moving and shaking every 5-10 seconds or s…
His usual viewers will be familiar with his “ML news” videos where the parody is way more in-your-face.
His usual style of video is a rather dry screen capture of him annotating a PDF, so I guess he does it for some lighthearted relief.
Re: ChatGPT, Rot13, and Daniel Kahneman
#198Re: ChatGPT, Rot13, and Daniel Kahneman
#199Earlier quoted context omitted.
I asked it to create an ASCII art banana and the result was hilarious. It then tried to explain it by elaborating that the 'O' was a curvy letter and represented the curves of the banana.
I asked it to draw me an ASCII art banana. It did not go well: https://imgur.com/a/5g2e9Ld
Re: ChatGPT, Rot13, and Daniel Kahneman
#200I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. That is the opposite of what many people, including me, have come to expect of computers. I have worked for many years in translation, lexicography, and language education, and I am flabbergasted at how well ChatGPT handles natural language. It can produce example sentences of po…
> I have yet to see ChatGPT make any grammatical mistakes in either English or Japanese. In French, I have seen it make the same conjugation mistakes as native speakers ("elle a terminée") as well as a few gender mistakes on conjugation (not sure which one exactly anymore, but something like "le lutin est tombée") which wouldn't be common for native speakers. But it is very good, I have been using it to translate Dut…