Earlier quoted context omitted.
you've got to be joking mate. >Google has “understood” English queries you can't, with a straight face, be comparing a Google search to what ChatGPT is doing. C'mon man. >In many cases it’s wrong. In many cases the result is below entry-level. Once again I'm baffled by this dismissal. I don't think you actually understand what you're seeing with ChatGPT. There is very interesting emergent behaviour occurring. Trying…
The advancement with these LLMs lies in the fact that they can effectively learn to recognize patterns within “large-ish” input text sequences and probabilistically generate a likely next word given those patterns. It’s a genuine advancement. However it is still just pattern matching. And describing anything it’s doing as “behavior” is a real stretch given that it is a feed-forward network that does not incorporate a…
the visual cortex in your brain is also "just a pattern matching" system. guess it's not very impressive by your standard.
This[1] isn't my example (it's from another HN user), but if you work as a programmer and you're not absolutely jaw on the floor astonished by this example then I don't know what to say.
Explaining[2] the emergent behaviour is literally cutting edge research. Hand waving this behaviour away as just "probabilistically generating a likely next word" is ignorant.
It's amazing in similar ways to Conway's Game of Life.
[2]https://ai.googleblog.com/2022/11/characterizing-emergent-ph...