Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

news.ycombinator.com

Post reply on HN
Print view View original

31–40 of 118 posts

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#31

Post by shusaku »

ulrikrasmussen wrote: post #19

I can't help but notice some similarities between GPT and fully self driving vehicles. Both technologies have come a long way and are quite impressive, but not quite there to actually be able to replace humans, and getting the last 10% of edge cases to work seems to require a monumental effort still.

It's so fun to play with too, which I guess is like owning a self driving vehicle and taking it for a spin. On a practical level though, I think it will have a big impact. For example, I'm watching a movie and I want to know the name of the actor of one character. Usually I'd go to google, scroll through wikipedia, etc. But ChatGPT seems really good at this, and answering all my follow up questions like "what other films are in they in".

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#32

Post by fckgnad »

ulrikrasmussen wrote: post #19

I can't help but notice some similarities between GPT and fully self driving vehicles. Both technologies have come a long way and are quite impressive, but not quite there to actually be able to replace humans, and getting the last 10% of edge cases to work seems to require a monumental effort still.

Hmm I don't think it will be a monumental effort. chatGPT is simply GPT-3 with more refined training on top of it where it's trained on users hand selecting better answers. This training definitely improved the quality of the answers and truthfulness of the answer above the original.

There needs to be further training on it where users specifically focus on hand selecting truthful answers on questions where chatGPT tends to lie. With further training on this end it's possible to improve the quality of the answer.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#33

Post by shusaku »

gadtfly wrote: post #20

This is an artifact of an implementation-specific trick that trades performance at character-level tasks for performance at everything else. It does not reflect anything inherent about this type of model's capabilities: https://www.gwern.net/GPT-3#bpes GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.…

I guess this explains some recent weird behavior I saw: 1) it failed writing haikus (in japanese) and 2) it couldn't get quite right the task of generating poems without the letter e in them.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#34

Post by yobbo »

gadtfly wrote: post #20

This is an artifact of an implementation-specific trick that trades performance at character-level tasks for performance at everything else. It does not reflect anything inherent about this type of model's capabilities: https://www.gwern.net/GPT-3#bpes GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.…

(It's not counting input tokens.)

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#35

Post by fckgnad »

siraben wrote: post #21

Interestingly, if you ask it to do the counting one by one it does it correctly. Is this still an artifact of how the tokenization works? If so how does it have the ability to separate the characters out? Q: how many letters are in the string djsjcnnrjfkalcr A: There are 18 letters in the string "djsjcnnrjfkalcr". Q: count them one by one A: Sure! Here are the letters in the string "djsjcnnrjfkalcr", counted one by o…

Interesting! ask it to introspect. Why and how did it make such a mistake?

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#36

Post by throw310822 »

Have any of you had experience interacting with a person with Down's syndrome? They might have the same troubles giving correct answers even to simple question and need guidance to answer them correctly. Would you say that they don't possess "general intelligence"? Of course not. Being unable to perform some tasks that seem trivial to us does not, per se, prove a lack of general intelligence.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#37

Post by lanternfish »

iLoveOncall wrote: post #30
gadtfly wrote: post #20

This is an artifact of an implementation-specific trick that trades performance at character-level tasks for performance at everything else. It does not reflect anything inherent about this type of model's capabilities: https://www.gwern.net/GPT-3#bpes GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.…

So how come the answer is 18 instead of 10 then?

Because it's learned from people saying '$STRING is $N characters' a rough correlation between the token length of $STRING and $N. Given infinite training and depth, it would learn how strings tokenize and resolve the question more accurately, but this is basically it guessing what the inflation of tokens->chars is and missing.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#38

Post by lmc » 

    Me: How many characters are in the string "sdfyskkgagag"?

    ChatGPT: The string "sdfyskkgagag" has 14 characters.

    Me: That is incorrect, please try again

    ChatGPT: I apologize for the mistake. The string "sdfyskkgagag" has 12 characters.
To me, that sounds like it has some understanding. Fallible and weird, but it's there.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#39

Post by omnicognate »

maxbond wrote: post #22
swyx wrote: post #18

this nitpicky luddism is so boring. For 100 years we’ve had machines that can do math Then we made a new kind of machine that can do words and now we’re complaining it can’t do math? Sounds a lot like you are judging a fish by its ability to climb trees.

I think people just want to explore the system & understand what mistakes it makes and why. I don't see anyone in this thread advocating against ChatGPT.

I'll advocate against it in its current form. I've seen lots of people saying they have been using ChatGPT heavily and have "learned a lot from it". Based on my own experimentation I'm certain these people have swallowed a large number of falsehoods.

Even I swallowed one despite actively looking for incorrect statements and posting its responses to friends in a discussion about its capabilities (my friends also swallowed it). It said something so mundanely plausible it didn't even occur to me to look it up until the next day, at which point I found it was a complete fabrication.

Even OpenAI's CEO, Sam Altman, says [1] people shouldn't be relying on it for factual queries.

It may come to be useful, but currently it's borderline dangerous.

[1] https://twitter.com/sama/status/1601731295792414720?ref_src=...

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#40

Post by vorticalbox »

tobr wrote: post #3

Yes, it can only guess at something that sounds reasonable. I had the same conversation about counting words in a sentence: > How many words are in this sentence? > In the sentence "How many words are in this sentence?", there are 9 words. > No, that’s actually wrong. Try to write some code that would count the words for you. > Certainly! Here is some Python code that will count the number of words in a given string:…

I just asked it this question and it replied.

> There is only one word in the sentence you provided, which is "sentence."

Post reply on HN