Live data from Hacker News

ChatGPT, Rot13, and Daniel Kahneman

jameswillia.ms

191–200 of 213 posts

Re: ChatGPT, Rot13, and Daniel Kahneman

#191

What exactly are people expecting? All transformer models, of which ChatGPT is just one big fancy example, are just pattern matchers based on a large corpus of text trying to find the next string that completes the pattern. There's no reasoning, no understanding. It's just a big fancy parrot. Now ask your parrot to do some math. Polly want an AI cracker? We clearly haven't cracked the code on AGI yet, and transformer…

What would it look like for it to not be "just an X", where X is the computational unit at the base level? If you look at a low enough level, any system will be made up of some basic units that manipulate signals in various ways. The brain is just neurons integrating signals and firing action potentials. But that doesn't make the system "just neurons firing action potentials".

Re: ChatGPT, Rot13, and Daniel Kahneman

#193
I had success getting it to translate the message after having it first list all the letter pairs and then giving it very detailed step-by-step instructions with a sample word (chicken). Here's the final ChatGPT response from our conversation.

I first tried it with just one word (pebff) but it forgot the final s. But it did great with the whole sentence!

---ME---

Yes, please decode the following message: "Jul qvq gur puvpxra pebff gur ebnq?"

---CHATGPT---

  To decode the message "Jul qvq gur puvpxra pebff gur ebnq?", we can follow the steps you outlined earlier:

  First, separate each letter on its own line:
  J
  u
  l

  q
  v
  q

  g
  u
  r

  p
  u
  v
  p
  x
  r
  a

  p
  e
  b
  f
  f

  g
  u
  r

  e
  b
  n
  q

  Then find the ROT13 equivalent of each letter:
  J -> W
  u -> h
  l -> y

  q -> d
  v -> i
  q -> d

  g -> t
  u -> h
  r -> e

  p -> c
  u -> h
  v -> i
  p -> c
  x -> k
  r -> e
  a -> n

  p -> c
  e -> r
  b -> o
  f -> s
  f -> s

  g -> t
  u -> h
  r -> e

  e -> r
  b -> o
  n -> a
  q -> d

  Next, get just the second letter on each line:
  W
  h
  y

  d
  i
  d

  t
  h
  e

  c
  h
  i
  c
  k
  e
  n

  c
  r
  o
  s
  s

  t
  h
  e

  r
  o
  a
  d

  Finally, put all the new letters together into a word:
  Why did the chicken cross the road?

  So, the decoded message for "Jul qvq gur puvpxra pebff gur ebnq?" is "Why did the chicken cross the road?"

Re: ChatGPT, Rot13, and Daniel Kahneman

#194
post #153
post #144

Earlier quoted context omitted.

This is not it or not sufficient explanation. chatGPT is able to read text with letters purposefully scrambled. Like those texts that show how humans have an innate ability to read text with letters misplaced. chatGPT can understand the text, figure out what is going on and produce text of the same type. I tried it, precisely to understand if it was working with words as its token. Interestingly, it cannot produce te…

Did you try entering one of those scrambled sentences into the tokenizer? It's not tokenizing words exactly- the doc says roughly ~100 tokens => 75 words.

I just tried out of curiosity. The jumbled words get broken up into different tokens, the unjumbled words do not get split.

https://imgur.com/a/a3zmkIv

Re: ChatGPT, Rot13, and Daniel Kahneman

#195
post #72

I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. That is the opposite of what many people, including me, have come to expect of computers. I have worked for many years in translation, lexicography, and language education, and I am flabbergasted at how well ChatGPT handles natural language. It can produce example sentences of po…

> I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. All this time developers have been freaking out about ChatGPT taking their jobs when it's really politicians that should be nervous!

A bright future lies in harnessing these language models and other types of ai in computational public policy. For example, humans can’t easily read and understand these massive bills that are written by our legislature.

Re: ChatGPT, Rot13, and Daniel Kahneman

#196

Earlier quoted context omitted.

This will sound trite, but I wonder whether there's a lesson here to be learned about human education. We put a great deal of effort into educating our children in language and math, to the extent that those form the major branches of our standardized testing for college admissions tests (where they are still used). We treat them as separate subjects, perhaps for good reason, as we also do science and geography and a…

That doesn’t sound trite to me at all. ChatGTP raises major issues for the future of education in many areas, and discussions about how to deal with them have just begun.

It will obsolete essay writing or make cheating more of a problem. This may be good. Multiple choice tests will be favored over things like term papers, which are basically meaningless as of now. This will favor general intelligence (iq) at least until there are interface advances like supposedly neurolink or wearables, at which point iq will matter less and big five traits much more. That would be beautiful in many ways, but a major inflection point for humans; no more elites. A great leveling may reduce violence and oppression, and increase prosperity across the globe.

Re: ChatGPT, Rot13, and Daniel Kahneman

#197

Earlier quoted context omitted.

It's just a guy talking. > Plus from the video: "do you have a thorough idea what OpenAI is doing, neither do I" - cut to strobe light and rock music. Jeesh, can't see that as support. The hell are you talking about? There's no strobe there, he just goes to a slide with a white background, and the music is very quiet compared to his voice and not at all something I would call "rock".

> It's just a guy talking. Maybe joe_the_user went overboard with calling it strobe light, but this is definitely not "just a guy talking". I don't know how people call this style of videos but it's very tiresome - constantly zooming in and out, full of sound effects (glass breaking, snaring, what not), changing backgrounds, changing lights, everything is just uncontrollably moving and shaking every 5-10 seconds or s…

The special effects are done as a parody, as you might be able to tell from the fact that his background is a green screen with nothing on it.

His usual viewers will be familiar with his “ML news” videos where the parody is way more in-your-face.

His usual style of video is a rather dry screen capture of him annotating a PDF, so I guess he does it for some lighthearted relief.

Re: ChatGPT, Rot13, and Daniel Kahneman

#199
post #52
post #26

Earlier quoted context omitted.

I asked it to create an ASCII art banana and the result was hilarious. It then tried to explain it by elaborating that the 'O' was a curvy letter and represented the curves of the banana.

I asked it to draw me an ASCII art banana. It did not go well: https://imgur.com/a/5g2e9Ld

That was an entertaining conversation, I didn't try to push it further after it made nonsense for me.

Re: ChatGPT, Rot13, and Daniel Kahneman

#200
post #72

I find it amusing that, at present, ChatGPT seems to be lousy at mathematical-type reasoning while being very good at natural language use. That is the opposite of what many people, including me, have come to expect of computers. I have worked for many years in translation, lexicography, and language education, and I am flabbergasted at how well ChatGPT handles natural language. It can produce example sentences of po…

> I have yet to see ChatGPT make any grammatical mistakes in either English or Japanese. In French, I have seen it make the same conjugation mistakes as native speakers ("elle a terminée") as well as a few gender mistakes on conjugation (not sure which one exactly anymore, but something like "le lutin est tombée") which wouldn't be common for native speakers. But it is very good, I have been using it to translate Dut…

You can also ask it to translate phonetically for a specified alphabet. Have it say things sarcastically. And then have it capitalize certain words to emphasize the sarcasm.
Post reply on HN