Live data from Hacker News

T0* – Series of encoder-decoder models trained on a large set of different tasks

huggingface.co

31–40 of 163 posts

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#33
post #7

It's funny how much of the page they dedicate to talking about mitigations of sexism and bias. Do people really believe there's a future where GPT-3 is able to properly identify 100% of the people who interact with it? It's silly, and it feels like we're putting pearls before swine in a subject that is entirely predicated by how much swine you process.

Making sure that NLP algorithms are unbiased is important not just from a social justice perspective, but from a perspective of how useful the algorithms are. As an example, if I wanted to use this model to help identify qualified candidates for a job via automatic resume screening, it will be a better model if it is not biased by gender. I, as someone who is hiring, don't want my model to be biased because then I'll…

I'd rather my resume go straight into the bin than be analyzed by some glorified Markov chain trained on reddit posts

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#35
Clearly history wasn't something it paid attention to in class. "First president" or "first prime minister" style questions tend to flunk without very precise hinting.

Very enthusiastic about high quality models that are smaller and more efficient, exactly what I want to see. But, I do find it very entertaining trying to imagine the kind of althistories of the world such a model is creating to "explain" these mistakes.

(Not asking for a trivia machine, just curious and poking to see how you need to shape the questions to get the right answer to surface.)

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#36

Is this model public? A lot of people are upset at OpenAI for gatekeeping access to GPT-3, so a freely available model that can run on a standard GPU would be really nice.

Yes! -> https://huggingface.co/bigscience/T0pp

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#37

Is this model public? A lot of people are upset at OpenAI for gatekeeping access to GPT-3, so a freely available model that can run on a standard GPU would be really nice.

Yes. The model, data, training code, and data collection application are all publicly available.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#39

Is this model public? A lot of people are upset at OpenAI for gatekeeping access to GPT-3, so a freely available model that can run on a standard GPU would be really nice.

You can run it right now with your own queries: see https://twitter.com/abidlabs/status/1450118978051903488

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#40
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

"How many hydrogen atoms are there?" "a total of 84"

42 x 2, can't be a coincidence.
Post reply on HN