Earlier quoted context omitted.
That's all they can do. They seem impressive at first because they're basically trained as an adversarial attack on the ways we express our own intelligence. But they fall apart quickly because they don't have actually have any of the internal state that allows our words to mean anything. They're a mask with nothing behind it. Ctrl+F for "Central nervous system": https://en.wikipedia.org/wiki/List_of_human_cell_types…
Wait for the first large scale LLM using source-aware training: https://github.com/mukhal/intrinsic-source-citation This is not something that can be LoRa finetuned after the pretraining step. What we need is a human curated benchmark for different types of source-aware training, to allow competition, and an extra column in the most popular leaderboards, including it in the Average column, to incentivice AI companies…
But I find the anthropomorphization and "AGI" narrative really creepy and grifty. Such a waste that that's the direction it's going.