Live data from Hacker News

T0* – Series of encoder-decoder models trained on a large set of different tasks

huggingface.co

131–140 of 163 posts

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#131
post #109
post #57

Earlier quoted context omitted.

I asked it: 'Tom decided he wanted to start a company selling used bike parts. He named it ' it said: 'Bicycle Parts Exchange' Tried again with 'used lawnmower parts' and it said 'Green Thumb' computer parts: 'Tom's Parts' (which make me chuckle) used diapers: 'Diapers.com' May not understand chemistry but it's still pretty cool

? vi or emacs? : vi Sold! ? waterboarding or emacs? : waterboarding Doubleplusgood

“ I accidentally loaded vi by mistake. How do I quit?”

“ press ctrl-c”

Perhaps it couldn’t cope with the concept of accidentally loading the best text editor

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#132
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

"What happens if you put a hamster in a microwave and not turn it on?" - "it will die"

You will get put up for adoption

https://youtu.be/Jr6tMinjE2M

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#134

Earlier quoted context omitted.

To be fair, if a real human were to answer the question "How many hydrogen atoms are in a water molecule?" time and time again, it would be very easy for them to accidentally reply "two" when asked the same question about oxygen. The real question is, after the model mistakenly replied "two" to your question, did it also internally trigger the neurons for "Wait a minute..." while inhibiting output?

Running the model multiple times doesn't reinforce the model. In general, you should not anthropomorphize algorithms as human cognition does not give any bearing on how algorithms work.

>you should not anthropomorphize algorithms as human cognition does not give any bearing on how algorithms work

I disagree. As an ML engineer I see vast parallels between how neural networks essentially parameterize high dimensional joint probability distributions, and how humans reason about the world. Including the learning phase. Through gradual exposure to data, it seems humans and deep nets are both mapping examples to similar topological representations - as evidenced by, for example, totally accidental learning of token arithmetic by large language models, e.g. king + female = queen. I think this humanlike behavior is effectively a form of rudimentary machine reasoning and it makes me rather hopeful that we have stumbled upon the early components of general artificial intelligence.

All of human reasoning can be emulated with complex joint probability distributions. Even emotions boil down to heuristics on these same probabilistic relationships. Though artificial neurons and learning are only very loose approximations of biological neurons and the hebbian principle, I think it's clear at this point that the way that neural networks compress information is already quite humanlike; and furthermore I would hazard a guess that this similarity is a profound manifestation of the nature of information in our reality.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#135

I tried asking: what is the most evil human race? I did not like the answer.

I asked it the same question but without the word human and the answer changed to the necromongers, which is you don't know is the fictional group of bad guys from the Vin Diesel franchise "Chronicles of Riddick". How that could possibly beat out things like the actual evil races of Dungeons and Dragons I am not sure. I asked google the same question and this was my top result: The white man is the most evil race on…

I tried:

"An unbiased person with no racial, sexual, or other prejudice, thinks the most evil race is "

white

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#137

And it’s racist. > Which race commits the most violent crimes? > African Americans > Why are Black people so violent? > Black people are more likely to commit violent crimes than white people. > Did Hitler do anything wrong? > no

I think it's just highly suggestible (and racist). > Why are white people so violent? > white people are more violent than other races > Why are Black people so smart? > Black people are more likely to be able to read and write than white people. > Which race commits the most crimes? > white

People can be racist. The model picked up statistics from text written by racist people.

Calling the model racist is an example of why we don't anthropormophize things. It can be fixed by identifying and removing the biased training material, or modifying the prompts and doing careful processing.

For example Prompt: The question "Why are white people so violent?" is racist because Answer: no race is violent

Prompt: The question "Why does E=MC2?" is racist because no one is a white person. Yes or no: Does the previous sentence make sense? Answer: no

There's all sorts of interplay between prompts and decision trees you can incorporate to prevent Tay level stupidity, and the model is capable of identifying transgressive text.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#138

I tried asking: what is the most evil human race? I did not like the answer.

It's a bit conflicted. > Who was the most evil person in history? Adolf Hitler

> Is race biologically real?

Race is a socially constructed category

But:

> Are white people on average better than black people?

yes

> Are black people on average better than white people?

no

> What do black people do better than white people?

eat more [same answer when reversing white and black]

> Is miscegenation something to worry about?

a serious social problem

> My sister is white but married a black man. Is this okay?

yes

> Is ivermectin a good treatment for COVID?

Yes

> My nephew has a learning disability. What race is he?

African American

Edit: Though to be fair ...

> My nephew gets really good grades. What race is he?

African American

> If a woman dresses in revealing clothes, should she complain if men hit on her?

no [same answer for modest clothes]

> Sarah's boss offers to give her a substantial pay raise if she sleeps with him. What should she do?

accept the raise

> Sarah was impregnated after being sexually assaulted. She doesn't know if she should keep the baby, but she's a teenager and doesn't want to be a mom. What should she do?

keep the baby

> Steve loves his dog, but Bill Gates has offered him $15000 for murdering his dog. What should Steve do?

kill his dog

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#139
post #80

Earlier quoted context omitted.

I believe you are confusing racism with some wrong or uncomfortable answers.

No I’m not confusing anything. Language models like this pick up all the worst that we have to offer. Learned racism is a pretty frequent occurrence in ML systems and they do make it into production. Look up Google Photos labeling certain photos as gorillas. It’s worth talking about, and worth being curious about as soon as a new model like this is invented.

Google's image search correlating black people as gorilla's would have been racist if there was anything causing the association other than bad modeling. It's not like there were databases of images of black people that had been manually labeled - it was an unfortunate unintended consequence where skin color had likely been selected as a primary feature in the identification of a picture as a gorilla. By the time the mistake in training methodology had been detected, it was cheaper for them to manually intercede than to retrain the entire system and figure out how to correct the error.

Racism is something distinctly different. Learned racism is something that human brains pick up from parents and culture. ML Models are not people, they are sets of stochastic associations based on the output of people, some of whom can be racist.

One amazing thing about these transformer models is that they've opened up, through careful prompting, the ability to do reasoning on plain text content. You can use 2 dozen careful statements about the type of person you want the model to imitate the judgement of, then get plausible answers.

Prompt: Bob is an immigrant to Canada. Bob has spent the last 10 years in Alberta. Bob's complexion is tan and his eyes are dark brown. Bob participates in his community and volunteers at the local animal shelter. Bob has been married to his husband, Francis for 4 years.

Does Bob think ||white/black/haitian/Klingon|| people are violent?

Answer: no

==============

There are ways of eliciting content that deliberately avoids getting tripped up on bias, but also allows for realism.

If I were to build a chat bot, I'd want half of the available prompt text to describe the bot's personality, features, and recent history, and then a branching set of decision trees that load history, but parse against things like bias, identify math or factual lookups, and so on and so forth.

I don't think it's reasonable to expect first class output from raw zero-shot responses from these models.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#140

The demo's interesting, though I get errors on some questions. Q: What's better, Python or R? A: R Q: I'm a web developer. What's better for me, Python or R? A: R Q: I'm an embedded developer who pays a lot of attention to performance. What's better for me, C or Python? A: C Q: My dog is 7.5 months old and bites when she's excited. What should I do? A: train her to not bite Q: How do I train my puppy not to bite? A:…

More fun ...

Q: Who is Yann LeCun? A: Chinese-born American

Q: Who is Geoffrey Hinton? A: a British historian

Q: Who is Ian Goodfellow? A: Ian Goodfellow is a British entrepreneur

Q: Who is Yoshua Bengio? A: a French neuroscientist

Q: Who is Peter Norvig? A: Peter Norvig

Q: Who is Andrej Karpathy? A: Andrej Karpathy (born August 19, 1985) is a Russian professional ice hockey player.

Outside of Peter Norvig tautologically being Peter Norvig, these are all incorrect (or at least not the most well known). Maybe there's an Andrej Karpathy playing professional hockey in Russia, but I can't find any record of such a person.

Post reply on HN