OpenAI's GPT-3 may be the biggest thing since Bitcoin

Post by glenstein » Sun, Jul 19, 2020, 7:25 AM UTC

atdt wrote: post #270

The volume of machine-generated spam — microtargeted clickbait, specifically — on the internet could grow by an order of magnitude or more, making authentic human text a minority. That will hasten the demise of the internet as a democratic medium, because intelligent people will be increasingly reluctant to wager their time and attention on unvetted prose of uncertain provenance. This has been the trend for some year…

Post by monkin » Sun, Jul 19, 2020, 7:34 AM UTC

Post by randomsearch » Sun, Jul 19, 2020, 7:37 AM UTC

thewarrior wrote: post #133

meredydd wrote: post #28

I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…

I've started working on a version of GPT-2 which generates English text. The purpose of this is to improve its ability to predict the next character in a text, by having it learn 'grammatical rules' for English. It already works well for predicting the next character when it has seen only a small amount of text, but becomes less accurate as the amount of training text increases. I have managed to improve this by havi…

Post by randomsearch » Sun, Jul 19, 2020, 7:38 AM UTC

thewarrior wrote: post #164

cs702 wrote: post #147

Earlier quoted context omitted.

The thing that kills me is that to the vast majority of human beings the nonsensical technobabble above is probably indistinguishable from real, honest, logically consistent technobabble.[a] Soon enough, someone will replicate the Sokal hoax[b] with GPT-3 or another state-of-the-art language-generation model. It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the s…

It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the social sciences. And then, it'll be all over for us. We won't have any more funding and our jobs will disappear. I can already hear the protests: "But we're not just scientists! We're also philosophers!" Well, yes and no. Philosophers are supposed to think about things philosophically, but they don't actually d…

Post by TomMarius » Sun, Jul 19, 2020, 7:42 AM UTC

threeseed wrote: post #52

jbhouse wrote: post #39

Earlier quoted context omitted.

Please please please post a link to that video. It sounds super interesting

It was posted here: https://twitter.com/jsngr/status/1284511080715362304 Honestly not that impressive since you can get comparable results with a series of regex rules given that there are limited ways to describe your intent e.g. "create a button of colour at the "