Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's GPT-3 may be the biggest thing since Bitcoin

maraoz.com

Post reply on HN
Print view View original

481–490 of 554 posts

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#481

Post by [deleted] »

user_50123890 wrote: post #412
abernard1 wrote: post #96

When I read comments like this--and yes I read the article and understand it was generated by an algorithm--I can't help but think the next AI winter is around the corner. This does not impress me in the slightest. Taking billions and billions of input corpora and making some of them _sound like_ something a human would say is not impressive. Even if it's at a high school vocabulary level. It may have underlying corr…

A new human doesn't come out of thin air, evolution has "trained" them with billions of inputs for billions of years.

[deleted]

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#482

Post by fnord77 »

qeternity wrote: post #19

Oh man. I don’t know where to begin. I’ll just say that this analysis is predicated on someone who thinks Bitcoin has proven anything in the real world. We’re way past BTC being a subculture experiment. Everyone knows about it. And still nobody (in the statistical sense) uses it.

Queen Elizabeth I was president of the United States in 1600.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#483

Post by dTal »

meredydd wrote: post #28

I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…

It is a bit unfortunate that your comment is now at the top - it spoils the test :)

Saying that, I briefly saw the first sentence of your comment and went to read the article with the idea that trickery was afoot, specifically guessing correctly the nature of the article. And yet, even then, on the back foot... it fooled me. Incredible.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#484

Post by tsimionescu »

thom wrote: post #380
ascar wrote: post #340

Earlier quoted context omitted.

Also both comments made me suspicious half way through and I scrolled to the bottom to check for a GPT-3 note. Without that note I would definitely have regarded it as incoherent rambling by a human. Especially the second comment can be coherently interpreted with some good will and a cynical view of the humanities and philosophy. The "author" could say that once GPT-3 can write humanities papers it will quickly make…

I think (slash worry) that this is going to be a simple upgrade in future iterations. Obviously there are powerful attention mechanisms at work to keep the subject matter coherent, but we’re not too far off the model being able to generate a core thesis, and ensure that all the generated text supports that in some way.

I think that if that worked it would prove that either language is a much more powerful tool than we realize, or our cognitive capacities are much more trivial than we realize.

The model fundamentally has no understanding of the world, so if it can successfully argue about a central thesis without simply selecting pre-existing fragments, then it would suggest that the statistical relations between words capture directly our reasoning about the world.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#485

Post by ALittleLight »

geofft wrote: post #238
6nf wrote: post #233

Earlier quoted context omitted.

How many attempts did it take or did you just choose the first one? I have to admit, this is passing my turing test...

Really? I got about halfway through and realized that the comment had no point . If you tried to summarize what it was arguing, beyond the first sentence, I don't think you could make a coherent summary. Maybe the real lesson is we don't expect human-written comments on discussion fora to be particularly coherent....

Unfortunately I saw the sentence at the end before reading the whole comment, so I don't know how my detector would've done, but I thought this line:

>In the not-too-distant future, there probably won't be any more philosophy professors; there will just be philosophers

Was quite clever and I'm still trying to figure out what it means.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#487

Post by dTal »

lowdose wrote: post #339
AnimalMuppet wrote: post #225

Earlier quoted context omitted.

I think I disagree. For example, I delayed in writing this comment because the cat was on my lap, and I couldn't fit the laptop and the cat both. You get that. I know you do, even if you don't own a cat, and even if you're reading this on a phone or a desktop. GPT-3 does not understand about the cat. To GPT-3, they're just words and phrases that occur in the vicinity of each other with certain probability distributio…

> But you the human understand, because you have a lap, and you've at least seen a cat on a lap. You really think GPT-3 never came across a comment about a cat in lap? 50% of all the pictures on the internet are cats sitting on people. GPT-3 doesn't need to understand it to echo this common knowledge. Airplanes don't look like birds at all but they do fly.

I don't see how any number of comments about cats in laps can allow it to synthesize the following logical chain: cat-on-lap -> pauli exclusion principle -> laptop NOT on lap -> laptop awkward to reach -> delayed comment

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#488

Post by antonvs »

488643689 wrote: post #353
Alex3917 wrote: post #63

Earlier quoted context omitted.

> Even on re-reading more closely, it doesn't feel like the world's best writing, but I don't notice major loss of coherence until the last couple of paragraphs. I guessed it was fake before getting to the end, not from the content, but from the fact that all the sentences are roughly the same length and follow the same basic grammatical patterns. Real people purposely mix up their sentence structure in order to keep…

Aww c'mon. You guessed it was fake, because it's an article about computer generated articles. Who would read that and not question the content in front? You are not analysing everything you read for oddities in writing style.

> You are not analysing everything you read for oddities in writing style.

I certainly do, don't you? When I read a blog post and it's full of poorly-integrated buzzwords that make it seem like it was churned out by a non-English speaker being paid very poorly per word, I stop reading and move on.

I recently read a few pages of a book someone had recommended to me and stopped reading because of the writing style.

Heck, you can read a few pages of, say, a Dan Brown novel, and based on the writing style might choose not to read it, since the style tells you a lot about the kind of book it is.

Post reply on HN