Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 118 posts

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#41

Post by rhn_mk1 »

throw310822 wrote: post #36

Have any of you had experience interacting with a person with Down's syndrome? They might have the same troubles giving correct answers even to simple question and need guidance to answer them correctly. Would you say that they don't possess "general intelligence"? Of course not. Being unable to perform some tasks that seem trivial to us does not, per se, prove a lack of general intelligence.

Thank you. I think every challenge about "AGI" should include an explanation of what "general intelligence" is. Is a toddler a "general intelligence"? Is my dog? Is a senile grandma?

Obviously, we don't have a widely agreed upon concept of intelligence. That makes all challenges of the form "is this an AGI" just a show of publicity: "look how silly it is!".

The only reasonable answer to an ill-defined question is "I don't know".

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#42

Post by [deleted] »

iLoveOncall wrote: post #30
gadtfly wrote: post #20

This is an artifact of an implementation-specific trick that trades performance at character-level tasks for performance at everything else. It does not reflect anything inherent about this type of model's capabilities: https://www.gwern.net/GPT-3#bpes GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.…

So how come the answer is 18 instead of 10 then?

[deleted]

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#44

Post by jacquesm »

cperciva wrote: post #5

My favourite is "prove that the square root of 4 is irrational". It produces a "proof"... and if further interrogated admits that 2 squared is 4, but insists that the square root of 4 is nonetheless an irrational number approximately equal to 2.00000.

To be fair, that 7th digit could be anything ;)

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#45

Post by parasti »

If you ask it to spell them out in a numbered list and point out the mistake, you can get it to recognize the error and correct it.

Basically, it's just too human. It's not always correct like we'd expect an AI to be. Just like humans aren't always correct.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#46

Post by zelphirkalt »

jacquesm wrote: post #43

The only thing missing now is a feedback loop that causes it to make such mistakes only once. That can't be that hard to add.

How many times does it need to be reported to gain sufficient weight to make it switch its answer?

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#47

Post by martyvis »

siraben wrote: post #21

Interestingly, if you ask it to do the counting one by one it does it correctly. Is this still an artifact of how the tokenization works? If so how does it have the ability to separate the characters out? Q: how many letters are in the string djsjcnnrjfkalcr A: There are 18 letters in the string "djsjcnnrjfkalcr". Q: count them one by one A: Sure! Here are the letters in the string "djsjcnnrjfkalcr", counted one by o…

I repeated this and got the same result. My follow-up :

  Q. why do you feel the need to apologize? Is there some correction needed in your arithmetic algorithms?

  A. As an artificial intelligence, I do not have feelings in the same way that humans do. However, I understand that it is important to acknowledge and apologize for errors, as this helps to maintain trust and improve the user experience. In this case, my error was a simple mistake, and it was not due to any issue with my underlying algorithms or programming. I apologize for any confusion that my mistake may have caused.
- See it was just a simple mistake ...

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#48

Post by bambax »

salamo wrote: post #10
bambax wrote: post #7

ChatGPT is assertive, authoritative, and even goes on to lie to justify its answers and "be right". It's a gasslighting machine. Here's an example I posted here a month ago: https://news.ycombinator.com/item?id=33852236

I think Ezra Klein framed it right during his interview of Gary Marcus: > And his point is that what’s different between bullshit and a lie is that a lie knows what the truth is and has had to move in the other direction. He has this great line where he says that people telling the truth and people telling lies are playing the same game but on different teams. But bullshit just has no relationship, really, to the tru…

Yes and no. It's true that when it reasons about the world ChatGPT doesn't know the truth and doesn't care, and just aims to be plausible, and it's simply bullshitting. And yes, this is the main problem with ChatGPT.

But when it reasons about the current conversation and invokes arguments and replies that weren't there, I think that should be called lying.

It's also a weird personality trait, something that is unlikely to have emerged on its own but was probably programmed into it. I don't know that for sure of course and have no information about how ChatGPT was put together, but from the outside it's troubling.

Re: ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

#50

Post by speed_spread »

swyx wrote: post #18

this nitpicky luddism is so boring. For 100 years we’ve had machines that can do math Then we made a new kind of machine that can do words and now we’re complaining it can’t do math? Sounds a lot like you are judging a fish by its ability to climb trees.

The point is not that it's wrong, it's that it's not aware of it's own limits and pretends to have an answer for a lot of things it's actually bad at. AI will stay dangerous until they learn to answer "I don't know" and "I'm not sure".
Post reply on HN