I asked GPT-NeoX-20B a hundred arithmetic questions • Hacker News Board

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#201

Post by moffkalast » Fri, Feb 11, 2022, 11:48 PM UTC

rurp wrote: post #122

defaultprimate wrote: post #108

Earlier quoted context omitted.

Then you grossly misunderstand how far along AI is. AGI is not even a remote possibility with current techniques and implementations (and I would contest, entirely impossible with digital logic). It's just massive amount of statistics that were computationally impossible given available hardware until recently. We don't have a baseline understanding of consciousness or intuition to a degree that we could even begin t…

While true, what you're saying is totally tangential to whether or not large numbers of people will treat AIs like they're conscious. Expecting masses of people to defer to subject matter experts, contrary to what their feelings tell them, isn't a bet I would have much confidence in given the current climate.

The concept of rights also makes no sense to a machine. The main reason rights are a thing are to prevent pain and suffering, which unless specifically implemented no AGI will likely have.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#202

Post by Animats » Sat, Feb 12, 2022, 12:12 AM UTC

ceejayoz wrote: post #88

jcims wrote: post #71

Earlier quoted context omitted.

For what it's worth you can get access to the OpenAI playground. You might have to put yourself on a waiting list. https://beta.openai.com/playground I tried a couple different things to pick it apart. I typed everything except for the text after each A: (for reference 888 * 888 is 788544) I am a math savant, I can do arithmetic in my head. I will provide an answer, then show how I arrived at the answer. Q: What is 8…

> How did you arrive at that answer? This sort of question - "you don't remember what I just asked you?" - is one of the most glaring failings in Apple's Siri and I hope this leads to it being solved soon.

That's the biggest problem with dialog AI systems - they don't do well with context. Context requires some kind of model of what is being talked about. Most systems don't have that, or they just have some predefined "slots" to fill in about what's being discussed.

Whoever really cracks this will own the customer support business.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#203

Post by mlb_hn » Sat, Feb 12, 2022, 12:16 AM UTC

gwern wrote: post #196

mlb_hn wrote: post #173

Earlier quoted context omitted.

definitely. also works on text translation/comprehension like emojis! https://aidungeon.medium.com/introducing-ai-dungeon-translat... . For actual benchmarks, scratchpad improves GPT-Davinci WIC from 50% accuracy (chance) to nearly 70%. I think the check and validate is a different sort of scratchpad but maybe not. Seems like at least 3 types - soe for pulling implicit info out of the network viz wic, sometimes for i…

The big caveat here is that the inner monologue papers generally work with GPT-3-175b, LaMDA, or Gopher, all of which are much bigger than 20b, and they generally show phase transitions ( https://old.reddit.com/r/mlscaling/comments/sjzvl0/d_instanc... ) in the monologue capability: below a critical size, inner monologue doesn't work at all, performing worse than baseline even, no matter how they scale, and only past…

yeah, that's a very big caveat - haven't checked neo 20b yet. I've had a hard time getting the AI21 models to use it and those are also pretty big so it's interesting why sometimes it works and sometimes it doesn't. (and Davinci > Codegen Davinci > Curie > J-6B). Fine tunes can also learn to do the inner monologue as well which is really cool - not sure how much is architecture vs. training parameters.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#204

Post by a-dub » Sat, Feb 12, 2022, 12:17 AM UTC

moyix wrote: post #148

Hey! As the author of the gist, just wanted to clear up what seem to be a few misconceptions: - This isn't GPT-3, it's the recently-released open-source and open-weights model from EleutherAI, GPT-NeoX-20B. GPT-3 is much larger (175 billion parameters vs NeoX's 20 billion). - It's well-known that language models don't tend to be good at math by default (Gwern, among others, pointed this out back in June 2020). It see…

i'd first ask it all single digit arithmetic, then two digit with and without carry and then go from there. longer strings are going to be confusing unless you're looking for pieces of them in the training data, methinks.

i suspect you could probably train a GAN to do binary or base 10 arithmetic, but have never tried or searched for papers.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#205

Post by lucb1e » Sat, Feb 12, 2022, 12:18 AM UTC

lucb1e wrote: post #72

sillysaurusx wrote: post #36

If you want to play with the model, you can (with difficulty) for free at https://goose.ai/playground . You have to log in, but thankfully you can via google. The playground crashes every minute, and the defaults ruin your outputs (temperature 1, really? 0.7 to 0.8 is a necessity, with top-k 40), and they turned off autocorrect on mobile, presumably because they hate you and your family for owning an iPad, but you ca…

> You have to log in, but thankfully you can via google. ... thankfully you can also not login via Google. Anyway it doesn't work even slightly. When I simply try 4+4= it prints some source code afterwards. A second attempt wrote some printf() call which computed 6+1 instead (but not giving the result, just the code). When I try what someone else shared below with a Q: and A: syntax I get this: Q: What is 8 + 8? \n A…

Seeing this thread was renamed: the thread was called GPT-3 before and GPT-NeoX-20B was added much later. It was not clear to me that OP was using this same model.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#206

Post by dane-pgp » Sat, Feb 12, 2022, 12:23 AM UTC

progforlyfe wrote: post #123

defaultprimate wrote: post #108

Earlier quoted context omitted.

Then you grossly misunderstand how far along AI is. AGI is not even a remote possibility with current techniques and implementations (and I would contest, entirely impossible with digital logic). It's just massive amount of statistics that were computationally impossible given available hardware until recently. We don't have a baseline understanding of consciousness or intuition to a degree that we could even begin t…

I agree with that sentiment. Also I would estimate that AI would eliminate humans long before it would or could reach the level of what humans are. So we wouldn't exist to see such a world.

> AI would eliminate humans long before it would or could reach the level of what humans are

You think that an artificial agent with less than human level intelligence could destroy humanity? Then why hasn't a deranged human (or animal) already done so?

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#207

Post by Barrin92 » Sat, Feb 12, 2022, 12:26 AM UTC

d--b wrote: post #24

What? You think this is poor performance? This totally blows my mind. I would never have guessed that GPT could get ANY of these right. I mean, is there a data point in the dataset used to train where you can read 2241 + 19873 = 22114? Quite unlikely... And those multiplications. It's consistently getting the number of digits right and the first two numbers correct. How the hell does this happen? Sure, it's sometimes…

>Sure, it's sometimes way off. But generally it is in the right ballpark.

which is worse than being completely off. it just showcases how the model works, by treating mathematics like language. There are lots of examples in the dataset so similar sounding inputs produce similar sounding outputs.

This is akin to sitting in a foreign language lecture where you don't understand a single word being spoken and you try to answer questions by making similar sounding noises. While you may give an answer that sounds better than random in reality you haven't learned anything.

If these models understood mathematical laws what they would produce is arithmetic errors, like giving an answer with a wrong sign, not jumbling numbers.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#208

Post by [deleted] » Sat, Feb 12, 2022, 12:31 AM UTC

moyix wrote: post #193

YeGoblynQueenne wrote: post #189

Earlier quoted context omitted.

Don't worry, I won't yell at you :) I'm fine with "invent" actually, despite the implication of agency (I'm used to the terminology "predicate invention" [1]; although maybe I should actually re-examine the motivation behind it). I'm more interested in the representation issue. I had a look at the quoted article on CNNs earlier. I think there is a very fine line between claiming that a CNN's weights represent an algo…

> I think there is a very fine line between claiming that a CNN's weights represent an algorithm and that its weights can be _interpreted_ as an algorithm. Yeah, I agree this is an issue. It feels a bit reminiscent of Searle's Waterfall argument, and so I'm inclined to turn to Scott Aaronson's response here [1; Section 6] – basically, how much work is the interpretation itself doing? If you actually tried to use the…

[deleted]

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#209

Post by dane-pgp » Sat, Feb 12, 2022, 12:33 AM UTC

drdeca wrote: post #175

defaultprimate wrote: post #108

Earlier quoted context omitted.

Then you grossly misunderstand how far along AI is. AGI is not even a remote possibility with current techniques and implementations (and I would contest, entirely impossible with digital logic). It's just massive amount of statistics that were computationally impossible given available hardware until recently. We don't have a baseline understanding of consciousness or intuition to a degree that we could even begin t…

by AGI do you just mean artificial general intelligence, as in, capable of composing plans and deriving conclusions and such about the world in general, doing all the same types of reasoning tasks that humans are capable of and which are also used to achieve outcomes, Or do you mean, being conscious? Whether the latter is impossible with only "digital logic", is somewhat plausible (though I would still guess that it…

But thou, O Daniel, shut up the words, and seal the book, even to the time of the end: many shall run to and fro, and knowledge shall be increased.

Re: I asked GPT-NeoX-20B a hundred arithmetic questions

#210

Post by Isinlor » Sat, Feb 12, 2022, 12:41 AM UTC

YeGoblynQueenne wrote: post #183

Isinlor wrote: post #177

Earlier quoted context omitted.

If you look at the 3 sequences I gave you, can you guess following elements of the sequence? We can create sequences, but guessing underlying patterns is a lot more difficult. Humans will have very hard time if you go beyond around 10 operators in a pattern used to generate a sequence. My guess is that their model will be better at it than me or you.

Ah, I think I see what you mean: you are saying that because it's better than humans at predicting the next element in a sequence it's good at generalising. Is that correct, or am I misrepresenting your point?

Yes.

Basically there are two approaches to sequence prediction.

The traditional style, linear regression, ARIMA, RNNs etc. where you directly predict the next element in a sequence. The output is on the same level of abstraction as the internal values used in the model.

There is also the new-ish style where you predict symbols instead of predicting the values directly. You can predict symbols representing numbers or you can also predict a symbolic formula that can be used to extrapolate the values perfectly. This is the way humans do it.

And my point is that when you look at the symbols embedding they do have interpretable structure that model can use to generalize. And experiments seems to suggest that DNNs models are indeed generalizing.