Earlier quoted context omitted.
You misunderstand what a language model is. What a human can or cannot do is frankly irrelevant. A GPT (Generative pretrained Transformer) is not a simulator nor an imitator. It is a predictor . Predictors try to reverse engineer the computation that could have led to a certain output so they don't just grok what is explicitly stated in a dataset but also what is implied by its structure. As an example, In a language…
I don't think the commenter's understanding of LLMs is relevant here. It's what the authors of TFA think LLMs are for and, arguably more importantly, what kinds of problems (nails) they think about when presented with the idea of applying LLMs (hammer). It's a bit ridiculous that this is the best they can come up with, and I don't really think the idea is worth defending, especially by telling other people that they…
It's not a perfect predictor so it's not impeccable for all conceivable situations but GPT-4 can already generate novel recipes that taste nice. This is not some far flung science fiction ability.