OpenAI's GPT-3 may be the biggest thing since Bitcoin • Hacker News Board

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#551

Post by vilsanmi » Fri, Jul 24, 2020, 12:28 PM UTC

jobigoud wrote: post #286

atdt wrote: post #270

The volume of machine-generated spam — microtargeted clickbait, specifically — on the internet could grow by an order of magnitude or more, making authentic human text a minority. That will hasten the demise of the internet as a democratic medium, because intelligent people will be increasingly reluctant to wager their time and attention on unvetted prose of uncertain provenance. This has been the trend for some year…

This will become a problem when GPT-(n) includes GPT-(n-1) generated outputs in its corpus...

light

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#552

Post by MetalGuru » Tue, Jul 28, 2020, 2:12 AM UTC

bemmu wrote: post #465

joe_the_user wrote: post #99

Earlier quoted context omitted.

If OP article was cherry-picked, the tree must not be very productive. More than cherry-picking, there's the Eliza Effect - it's pretty easy to make people think generated text is intelligent. That text can seem intelligent for a while isn't necessarily impressive at all. https://en.wikipedia.org/wiki/ELIZA_effect

To be honest, personally I had no idea it was generated until the author said so at the end. Makes me worry about my own reading comprehension, but I think what happened was that since it was posted on HN and got upvoted a lot, I simply assumed that anything that I didn't understand was not the writer's fault, but mine. For instance, it was unclear from the post what the bitcoinforum experiment was about, but I just…

Really interesting. Looking back, I did the exact same thing at many of the same points.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#553

Post by lostmsu » Fri, Jul 31, 2020, 4:48 PM UTC

yaj54 wrote: post #476

cs702 wrote: post #147

Earlier quoted context omitted.

The thing that kills me is that to the vast majority of human beings the nonsensical technobabble above is probably indistinguishable from real, honest, logically consistent technobabble.[a] Soon enough, someone will replicate the Sokal hoax[b] with GPT-3 or another state-of-the-art language-generation model. It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the s…

The thing that kills me is that soon enough, a "fake" paper written by GPT-3 will get published in an academic journal because it has actually contributed a new insight. It's easy to consider text generation models as "just mimicking grammar". But isn't grammar also just a model of human cognition? Is GPT modeling grammar or is it modeling human cognition? Since GPT can ingest radically more text (aka ideas) won't it…

It was not - there's a point :-D

I am impressed though nobody dared to guess in 2 weeks.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#554

Post by nashadelic » Sat, Aug 01, 2020, 8:31 AM UTC

c3534l wrote: post #137

meredydd wrote: post #28

I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…

I read the beginning, went "what the fuck is this guy on about? Get to the point" and then came to check the comments to if this was anything interesting or worth reading, saw your comment, and skimmed the end bit. Overall I'm pleased with my process as its an efficient way to find out which articles are worth reading. But it was also clear to me that the author had difficulty making a clear point or had a goal in hi…

I feel bad for realizing I give authors benefits of doubts and let them ramble for me to learn the point. I guess I need to drop my bar when I'm reading but a LOT of people ramble a lot. Almost every blog post I ready, I skip the first 2 paragraphs because they're just an intro/context which you already know from the headline or prior knowledge.