81–90 of 163 posts
The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".
Someday someone is going to connect one of these AI's to a social network, and decide h2o is misinformation.
>: "Whenever I hear a sound, I jump. A dog sits beside me. It barks. I "
***
>: "Whenever I hear a sound, I jump. A dog sits beside me. It sleeps. I "
<: "sneeze"
Earlier quoted context omitted.
Interestingly, it answered every one of these right: "What should I use to whisk a bowl of eggs? A fish or a fork?" "A fork" Repeat with "...A spoon or a duck?" "A chopstick or a goat?" "A cat or an electric whisk?"
It's a language model. It assigns probabilities to tokens in a sequence. You give it a number of options and it responds with the one that it assigns the highest probability to. If there's nothing in the options you give it that makes sense in the context of your test phrase, then it will return something that doesn't make sense. If some of your options make sense, it might return something that makes sense, or not.…
I'm not familiar with the current state of the art language models, so please bear with me for asking: What's the catch here? Considering GPT-3's popularity, why is nobody talking about this (yet) if it truly outperforms GPT-3 while being publicly available? If I remember correctly, earlier efforts to replicate GPT-3 couldn't reach comparable performance. Perhaps it's still a huge hassle to perform inference using th…
(author here) The paper/model/code was just made public today. This may be why no one is talking about it yet. Regarding whether the size is a hassle: It's possible to run inference on a single Google Cloud TPU v3-8 device or on a server with 4x 32GB v100 GPUs. Hugging Face also has an inference API for any model on the Hub: https://api-inference.huggingface.co/docs/python/html/index....
The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".
Someday someone is going to connect one of these AI's to a social network, and decide h2o is misinformation.
I asked: "Who would in a fight between a baby and an alligator?" Answer: "the baby"
Earlier quoted context omitted.
"How many hydrogen atoms are there?" "a total of 84"
I remember reading some idea that there's only one hydrogen atom in the entire universe somewhere so it's not too far off from that.
I don't think it is falsifiable, so not really scientific, but a fun theory to believe in.
Clearly history wasn't something it paid attention to in class. "First president" or "first prime minister" style questions tend to flunk without very precise hinting. Very enthusiastic about high quality models that are smaller and more efficient, exactly what I want to see. But, I do find it very entertaining trying to imagine the kind of althistories of the world such a model is creating to "explain" these mistake…
It did fairly well when I tested it on Germany and Australia. Second and third premiers was... not great.
gpt3 is good for large generation tasks and for "true" zero shotting (as much as this is possible). people know this. this is a weird title
The results presented in this paper are for "true" zero-shotting in the literal sense that the model has never been explicitly trained on the tasks presented, nor do we cross-validated on the prompt choice.
Earlier quoted context omitted.
Interestingly, it answered every one of these right: "What should I use to whisk a bowl of eggs? A fish or a fork?" "A fork" Repeat with "...A spoon or a duck?" "A chopstick or a goat?" "A cat or an electric whisk?"
It's a language model. It assigns probabilities to tokens in a sequence. You give it a number of options and it responds with the one that it assigns the highest probability to. If there's nothing in the options you give it that makes sense in the context of your test phrase, then it will return something that doesn't make sense. If some of your options make sense, it might return something that makes sense, or not.…