ChatGPT: How many letters has the string “djsjcnnrjfkalcr”?

ChatGPT, in its current generation, is best compared to an incompetent manager (think The Office). It gives eloquent answers with a high degree of confidence, however, the answers are sometimes comically wrong.

I do love ChatGPT though and would love for it to be integrated in Word or Google Docs. It is great at producing a first draft for performance reviews, pay rise letters, writing letters of complaints or challenging a parking fine.

Yeh so this and other examples for me demonstrate that ChatGPT has no logic per se. These examples demonstrate that it is not analysing your question and calculating the answer, instead it is approximating and answer based on a corpus of questions. So in essence it doesn't actually yet understand what you are asking it.

I'd be intrigued to see some kind of amalgamation of an AI tool like ChatGPT with a logic tool (say Wolfram Alpha-style). That would combat a lot of the ways folks have found to break this.

These ChatAI's are just "generally agreeable".

this nitpicky luddism is so boring.

For 100 years we’ve had machines that can do math

Then we made a new kind of machine that can do words

and now we’re complaining it can’t do math?

Sounds a lot like you are judging a fish by its ability to climb trees.

This is an artifact of an implementation-specific trick that trades performance at character-level tasks for performance at everything else. It does not reflect anything inherent about this type of model's capabilities: https://www.gwern.net/GPT-3#bpes

GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.com/tokenizer.