Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's GPT-3 may be the biggest thing since Bitcoin

maraoz.com

Post reply on HN
Print view View original

201–210 of 554 posts

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#201

Post by canjobear »

abernard1 wrote: post #187
natch wrote: post #172

Earlier quoted context omitted.

This kind of facile moving the goalposts is imho a cheap shot and (not imho, fact) is a recurring phenomenon as we make incremental progress toward AI. Progress is often made with steps that would have been astonishing a few years ago. And every time the bar is raised higher. Rightly so, but characterizing this as doing the wrong thing is missing the point of what we, and the system, are learning. Yes it's not intell…

> This kind of facile moving the goalposts is imho a cheap shot and (not imho, fact) is a recurring phenomenon as we make incremental progress toward AI. I think you missed my point. I think we're going in the wrong direction for AI entirely, and these "advances" are fundamentally misguided. OpenAI is explicitly about "intelligence," and so we should question if this is in fact that. It's clear that humans have funda…

> think we're going in the wrong direction for AI entirely

This direction has produced results that eluded 30+ years of research. What is the evidence that this is the wrong direction?

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#202

Post by blueblimp »

m3kw9 wrote: post #106
meredydd wrote: post #28

I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…

Problem was I lost interest half way because it lost my interest after the 2nd paragraph. For those that say it was good till the last few is really pretending to understand what it said. It really did not made much sense.

I'm finding with secret GPT-3 output that I often find it boring before realizing it's GPT-3. I might even be getting to recognize its wordy, dull, cliche-ridden, borderline-nonsensical style. It's remarkably good at passing as human writing of no value whatsoever.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#203

Post by manquer »

drcode wrote: post #27
thom wrote: post #13

Earlier quoted context omitted.

How would you measure human level AI?

I think the only measure that makes sense is https://en.wikipedia.org/wiki/I_know_it_when_I_see_it

ironically being able to do that is a key aspect of intelligence .

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#204

Post by kevmo314 »

abernard1 wrote: post #196
abernard1 wrote: post #163

Earlier quoted context omitted.

> Hasn't the typical human taken in orders of magnitude more data than this example? Have you read GPT-3s 175 billion parameters (words, sentences, papers, I don't care) of anything? Do you know all the words used in that corpus? Nobody has or does. A child of a small age can listen to a very small set of things and not just come up with words to communicate with mama and papa what they learned, but they can reuse it…

> This post was generated using GPT-3. [;)] Your post was generated using GPT-3 and 175 billion parameters of pre-existing human writing, contextualized, distilled, and cross-referenced with terminology we've agreed on for centuries. It's a parrot, and I remain unimpressed. Take the learned knowledge of GPT-3 (because it must be so smart right?) and have it actually do something. Buy stocks, make chemical formulas, b…

> That post was generated using GPT-3 and 175 billion parameters of pre-existing human writing, contextualized, distilled, and cross-referenced with terminology we've agreed on for centuries.

So basically like DNA?

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#205

Post by Robotbeat »

throwawaygh wrote: post #200

The world: the comment section/youtube playlist/twitter feed is full of nobodies who've learned to optimize for clickthrough but have no fucking clue what they're talking about. This is becoming a serious problem for society. Open AI: Hold my beer (also, something something AI safety something)

It’s pretty well established that OpenAI abandoned AI safety for a while, now.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#206

Post by throwawaygh »

bjourne wrote: post #192
nbardy wrote: post #9

Earlier quoted context omitted.

One of the biggest issues is with cherry-picking. Generative ML results benefit greatly from humans sampling the best results. They are capable of producing astonishing results but don’t do this consistently this has a huge impact on any effort to productize. For example I’ve seen quite a few examples of text->design, text->code, with GPT-3 you could build a demo in a day, but the product will probably be useless if…

True! That means that whoever can come up with a system that takes 10 texts written by GPT-3 and always selects the best one (as judged by humans) will become rich and famous. This sampling problem is one of the few major hurdles before generative ai:s become really useful.

> rich

Is reddit gold really that valuable?

> famous

Surely there are easier ways.

> really useful

We already have enough 2020 reddit commenters regurgitating 2010 hn threads regurgitating 2000 slashdot threads, thanks.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#207

Post by jjoonathan »

thewarrior wrote: post #164
cs702 wrote: post #147

Earlier quoted context omitted.

The thing that kills me is that to the vast majority of human beings the nonsensical technobabble above is probably indistinguishable from real, honest, logically consistent technobabble.[a] Soon enough, someone will replicate the Sokal hoax[b] with GPT-3 or another state-of-the-art language-generation model. It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the s…

It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the social sciences. And then, it'll be all over for us. We won't have any more funding and our jobs will disappear. I can already hear the protests: "But we're not just scientists! We're also philosophers!" Well, yes and no. Philosophers are supposed to think about things philosophically, but they don't actually d…

Somebody get this thing onto scp-wiki, it will be right at home.

Not gonna lie, I went poking around to see if I could get my hands on it, but it seems like the answer is no, for now.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#208

Post by abernard1 »

abernard1 wrote: post #196
abernard1 wrote: post #163

Earlier quoted context omitted.

> Hasn't the typical human taken in orders of magnitude more data than this example? Have you read GPT-3s 175 billion parameters (words, sentences, papers, I don't care) of anything? Do you know all the words used in that corpus? Nobody has or does. A child of a small age can listen to a very small set of things and not just come up with words to communicate with mama and papa what they learned, but they can reuse it…

> This post was generated using GPT-3. [;)] Your post was generated using GPT-3 and 175 billion parameters of pre-existing human writing, contextualized, distilled, and cross-referenced with terminology we've agreed on for centuries. It's a parrot, and I remain unimpressed. Take the learned knowledge of GPT-3 (because it must be so smart right?) and have it actually do something. Buy stocks, make chemical formulas, b…

> So basically like DNA?

Sigh. When DNA becomes human, it doesn't have a-priori access to all the world's knowledge and yet it still develops intelligence without it. And that little DNA machine learns and grows over time.

When thousands of scientists and billions of human artifacts and 1000X more compute are put into the philosophical successor of GPT-3, it won't be as impressive as what happens when a 2 year old becomes a 3 year old. (It will probably make GPT-4 even less impressive than GPT-3, because the inputs vis-a-vis outputs will be even that much more removed from what humans already do.)

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#210

Post by sgibat »

exolymph wrote: post #134
simonsarris wrote: post #80

I could tell this was GPT-3 because it reads like SEO-style sentence structure :/ > I imagine that similar results can be obtained by republishing GPT-3’s outputs to other message boards, blogs, and social media. I actually wrote a bit about this scenario and how it could explode comment sections to stonewall topics, which I'm calling Commentdämmerung: https://simonsarris.com/commentdammerung Still, I think a lot of…

Have you tried cowriting with it? Incredible for first drafts.

What's that process like? How do you use it when writing drafts?
Post reply on HN