Earlier quoted context omitted.
Any measure? ChatGPT still can’t solve a sudoku, let alone do any form of reasoning. It’s more of a search engine than “intelligence”, while humans obviously can reason and solve novel tasks.
> ChatGPT still can’t solve a sudoku, Now you've got me wondering, if there's even an appropriate test set to find out. When I do a sudoku, it's either printed and then I don't know if I made a mistake until the very end; or it's on a computer which tells me about mistakes as soon as I make them. I do know I make mistakes when doing them, but I don't know how often — more or less frequently than ChatGPT. (Also, at le…
It fundamentally can’t come up with a novel reply, unlike a human. It breaks spectacularly the instant you go off its training set, which is very easy to notice if you ask it about a topic you are knowledgeable about.