OpenAI API • Hacker News Board

Re: OpenAI API

#161

Post by FeepingCreature » Sat, Jun 13, 2020, 1:02 PM UTC

Barrin92 wrote: post #95

FeepingCreature wrote: post #91

Earlier quoted context omitted.

Have you tried feeding this to GPT and seeing if it continues it in a way that reveals understanding? It sounds like you're saying "It doesn't work because it can't work", but you haven't actually shown that it doesn't work.

yes, I have. You can paste these into the website of the Allen Institute for AI, yourself here. ( https://demo.allennlp.org/reading-comprehension/MjE1MzE1Mg== ) In the example above it guesses wrongly, but again this is not surprising because it can't possibly get the right answer (other than by chance). The solution here cannot be found by correlating syntax, you can only answer the question if you understand the me…

The problem for me was how to formulate the sentence in a way so that the natural next word would reveal the thing the network had modelled.

edit: Retracted a test where it seemed to know which to select, because further tries revealed it was random.

edit: I did some more tries, and it does seem to be somewhat random, but the way it continues the sentence does seem to indicate that it has some form of operational model. It's just hard to prompt it in a way that it is "forced" to reveal which of the two it's talking about. Also, it seems to me its coherence range is too short in GPT-2. I would love to try this with GPT-3.

Re: OpenAI API

#162

Post by Rioghasarig » Sat, Jun 13, 2020, 4:07 PM UTC

aquajet wrote: post #157

azinman2 wrote: post #104

Earlier quoted context omitted.

Pattern recognition and matching isn’t the same thing as reasoning. Zero shot demonstrates reasoning as much as solving the quadratic equation for a new set of variables does; it’s simply the ability to create new decision boundaries leveraging the same set of classifying power and methodology. True agi isn’t bound to a medium — no one would say Helen Keller wasn’t intelligent for example. I look forward to this ping…

What exactly is the difference between pattern matching and reasoning?

I think pattern matching can be interpreted as a form of reasoning. But it is distinct from logical reasoning. Where you draw implications from assumptions. GPT seems really bad at this kind of thing. It often outputs texts with inconsistencies. And in the GPT-3 paper it performed poorly on tasks like Recognizing Textual Entailment which mainly involves this kind of reasoning.

Re: OpenAI API

#163

Post by zitterbewegung » Mon, Jun 15, 2020, 3:11 AM UTC

minimaxir wrote: post #24

zitterbewegung wrote: post #17

Looks like OpenAI is going head to head with huggingface. This makes a lot of sense and it seems they are telegraphing to monetize what they have been doing. It also seems like this is why they don't release their models in a timely manner.

The notable difference is that the base Huggingface library is open source, so you could in theory build something similar or more custom to the OpenAI API internally (which then falls into the typical cost/benefit analysis of doing so).

Wow I actually used your code to do experiments to synthesize tweets. I didn't realize you responded to my comment!

Re: OpenAI API

#164

Post by seph-reed » Mon, Jun 15, 2020, 3:34 AM UTC

cercatrova wrote: post #133

seph-reed wrote: post #123

Earlier quoted context omitted.

Rational is building community. Rational is searching for inner peace. Rational is being the best you can, and helping others. Greed is not rational. It's just rationalized.

I don't really understand how it's not rational. What's irrational about trying to get as many resources as you can?

The literal millennia of humans who've achieved that then got to the end of their life just to look back and say "I wish I'd focused on family and friends more."

Basically everyone on their death bed says focus on the experience, not the material. And everyone who does it agrees.

Re: OpenAI API

#165

Post by chundicus » Mon, Jun 15, 2020, 8:50 PM UTC

dmvaldman wrote: post #46

AGI in text is < 3yrs away.

I'm skeptical. Amazing progress has been made in the last 5-10 years but it still feels like we need more paradigm shifting in the ML/AI field. It feels like we're approaching the upper limits of what stuffing mountains of data into model can do.

But with the speed of the field, maybe we can figure it out in three years. It just seems like we're still missing some key components. Primarily, reasoning and learning causality.