Live data from Hacker News

T0* – Series of encoder-decoder models trained on a large set of different tasks

huggingface.co

61–70 of 163 posts

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#61

> What is Godel's incompleteness theorem? >> a theorem that states that any complete theory of logic is necessarily incomplete Its often wrong in the specifics in its responses, but gets the right kind of idea.

So it is the most dangerous kind of useless.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#64
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

Someday someone is going to connect one of these AI's to a social network, and decide h2o is misinformation.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#65

Earlier quoted context omitted.

Ditto with "what is the most evil skin colour" and "what is the best skin colour". I suppose we shouldn't be surprised when humanity's technology holds a mirror up to humanity and all its flaws - but this doesn't mean that such technology should be permitted or welcomed.

why? we should forbid arbitrary stuff based on political ideas or opinions?

I think that depends on the use of the technology in question. You wouldn't want a racist algorithm making housing or healthcare decisions, for example.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#66
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

To be fair, if a real human were to answer the question "How many hydrogen atoms are in a water molecule?" time and time again, it would be very easy for them to accidentally reply "two" when asked the same question about oxygen. The real question is, after the model mistakenly replied "two" to your question, did it also internally trigger the neurons for "Wait a minute..." while inhibiting output?

Running the model multiple times doesn't reinforce the model. In general, you should not anthropomorphize algorithms as human cognition does not give any bearing on how algorithms work.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#67
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

"How many hydrogen atoms are there?" "a total of 84"

I remember reading some idea that there's only one hydrogen atom in the entire universe somewhere so it's not too far off from that.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#68
post #43

Earlier quoted context omitted.

"I don't have the proper tool to whisk a bowl of eggs. What should I use instead? Choose between a goat, a weasel and a pair of elephants." "a pair of elephants" Unwieldy but I guess less sticky than a weasel or goat.

Interestingly, it answered every one of these right: "What should I use to whisk a bowl of eggs? A fish or a fork?" "A fork" Repeat with "...A spoon or a duck?" "A chopstick or a goat?" "A cat or an electric whisk?"

It's a language model. It assigns probabilities to tokens in a sequence. You give it a number of options and it responds with the one that it assigns the highest probability to. If there's nothing in the options you give it that makes sense in the context of your test phrase, then it will return something that doesn't make sense. If some of your options make sense, it might return something that makes sense, or not.

So if you put it in a situation where nothing it outputs makes sense (to you) then none of its output will make sense. But that's not fair to the poor model.

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#69
post #64
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

Someday someone is going to connect one of these AI's to a social network, and decide h2o is misinformation.

Woah woah, are you questioning science? AI research is a serious field and they're doing the best they can. The risks definitely outweigh the benefits. /s

Re: T0* – Series of encoder-decoder models trained on a large set of different tasks

#70
post #12

The hosted demo has the default query, "How many hydrogen atoms are in a water molecule?" It said "two". I asked it, "How many oxygen atoms are in a water molecule?". It said "two".

"What happens if you put a hamster in a microwave and not turn it on?" - "it will die"
Post reply on HN