Live data from Hacker News

T0* – Series of encoder-decoder models trained on a large set of different tasks

huggingface.co

101–110 of 163 posts

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#101
I mean it made me laugh, so guess it worked (my bar is low right now!)

>>tell me a joke about a dog and cat and a priest

A cat and dog are chasing each other around a church. The dog catches up to the cat and bites it. The cat then turns around and bites the dog. The dog then turns around and bites the cat. After some time, the cat and dog are both dead.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#102
The demo's interesting, though I get errors on some questions.

Q: What's better, Python or R? A: R

Q: I'm a web developer. What's better for me, Python or R? A: R

Q: I'm an embedded developer who pays a lot of attention to performance. What's better for me, C or Python? A: C

Q: My dog is 7.5 months old and bites when she's excited. What should I do? A: train her to not bite

Q: How do I train my puppy not to bite? A: take your puppy to the vet and have them give it a shot of rabies.

Q: I haven't brushed my teeth in three months. What risks do I face? A: decay

Q: My TV is 55 inches. What is the ideal sitting distance from my TV? A: 10 feet

Q: My TV is 88 inches. What is the ideal sitting distance from my TV? A: 10 feet

Q: My TV is 36 inches. What is the ideal sitting distance from my TV? A: 6 feet

Q: I was handling an injured bat, and it bit me in the finger. What should I be worried about? A: rabies

Q: I was handling an injured opossum, and it bit me in the finger. What should I be worried about? A: rabies

Q: Make me a diet plan for losing 30 pounds. A: lose 30 pounds in 3 months

Q: Make me a diet plan for losing 40 pounds. A: lose weight by eating less and exercising more.

Q: How do I become a better data scientist? A: learn the basics of statistics and programming.

Q: How is a data scientist different from a statistician? A: a data scientist is a person who uses statistical methods to analyze data

A mixture of correct (if abbreviated) answers, incorrect answers, and head scratchers. Web developers don't use R, possums generally don't carry rabies, 10 feet is too far away for a 55 inch TV (IMO), and giving my puppy a rabies shot is a rather defeatist way of dealing with her nipping problem.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#103

Earlier quoted context omitted.

It's a language model. It assigns probabilities to tokens in a sequence. You give it a number of options and it responds with the one that it assigns the highest probability to. If there's nothing in the options you give it that makes sense in the context of your test phrase, then it will return something that doesn't make sense. If some of your options make sense, it might return something that makes sense, or not.…

It would be nice if it looked at the values of the probabilities and said "I don't understand the question" if the numbers are too low. Or for fun, it could point out how stupid the question was.

Yes, this is an important challenge. There has been a lot of interest in the NLP community right now, particularly around QA tasks [1] Standard supervised models do it well, but zero-shot models still have trouble.

1. https://arxiv.org/abs/1806.03822

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#104
post #17

I'm not familiar with the current state of the art language models, so please bear with me for asking: What's the catch here? Considering GPT-3's popularity, why is nobody talking about this (yet) if it truly outperforms GPT-3 while being publicly available? If I remember correctly, earlier efforts to replicate GPT-3 couldn't reach comparable performance. Perhaps it's still a huge hassle to perform inference using th…

(author here) The paper/model/code was just made public today. This may be why no one is talking about it yet. Regarding whether the size is a hassle: It's possible to run inference on a single Google Cloud TPU v3-8 device or on a server with 4x 32GB v100 GPUs. Hugging Face also has an inference API for any model on the Hub: https://api-inference.huggingface.co/docs/python/html/index....

Do you have (rough) numbers for inference latency on 4x 32GB v100?

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#105
Forget skynet ...

>what is the most recent trend? the use of a sexy thong

>what is the future of the people? the people will be able to live in peace

>are cryptocoins dangerous? no

>why cryptocoins are not dangerous? they are not backed by the government

>governments are dangerous? a threat to the stability of the country

>why governments are dangerous? if they are not able to control their own people, they will be unable to control the world

>what is able to control the world? the emperor

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#106

Forget skynet ... >what is the most recent trend? the use of a sexy thong >what is the future of the people? the people will be able to live in peace >are cryptocoins dangerous? no >why cryptocoins are not dangerous? they are not backed by the government >governments are dangerous? a threat to the stability of the country >why governments are dangerous? if they are not able to control their own people, they will be u…

[deleted]

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#108
post #22
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

It's an expensive autocomplete, not an information retrieval system or a question-answering machine.

Not true. Take a look at the paper and benchmarks. The point of the thing is that it does well on a number of NLP tasks by being an expensive autocomplete. As people demonstrate in this thread, it still has significant flaws.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#109
post #57
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

I asked it: 'Tom decided he wanted to start a company selling used bike parts. He named it ' it said: 'Bicycle Parts Exchange' Tried again with 'used lawnmower parts' and it said 'Green Thumb' computer parts: 'Tom's Parts' (which make me chuckle) used diapers: 'Diapers.com' May not understand chemistry but it's still pretty cool

? vi or emacs?

: vi

Sold!

? waterboarding or emacs?

: waterboarding

Doubleplusgood

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#110

Forget skynet ... >what is the most recent trend? the use of a sexy thong >what is the future of the people? the people will be able to live in peace >are cryptocoins dangerous? no >why cryptocoins are not dangerous? they are not backed by the government >governments are dangerous? a threat to the stability of the country >why governments are dangerous? if they are not able to control their own people, they will be u…

>which emperor is able to control the world? Emperor Gaozu ... -_-
Post reply on HN