Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's GPT-3 may be the biggest thing since Bitcoin

maraoz.com

Post reply on HN
Print view View original

521–530 of 554 posts

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#521

Post by rsync »

nullc wrote: post #157
Dangeranger wrote: post #131

Earlier quoted context omitted.

Can you elaborate on how you are having GPT2 contribute to your comments? What is your process?

I write a prompt, often copying text from the articles or other comments, and have it generate a lot of completions. I skim over the completions and grab interesting parts. For example, complaining about "quoted text" in my above comment was GPT2's suggestion (and also an actual issue with GPT2 which it was exhibiting by producing that text). Actually, all the text above from "There are a few" and beyond were written…

"Can you elaborate on how you are having GPT2 contribute to your comments? What is your process?"

...

"I write a prompt, often copying text from the articles or other comments, and have it generate a lot of completions."

...

Can you elaborate, even further, with details about the actual UI of GPT2/3 (which I have never used, nor seen used) ?

What I mean is ... when you "write a prompt", is that stdio on the command line ? Can you paste an example ?

Do you, then, get a single "completion" as an stdio result and ... you can just get new ones by up-arrowing and repeating your command ?

Am I getting warm here or am I stuck in a unix command centric paradigm of what this all looks like ?

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#522

Post by rsync »

briga wrote: post #45
graham_paul wrote: post #7

Earlier quoted context omitted.

> no-one can train GPT-3 in any acceptable time except for those with access to large GPU/ASIC compute power (OpenAI, Microsoft, Google, NVIDIA, etc.) Any state actor has access to large compute power

But it might be hard to attract talented AI engineers to live in, say, North Korea

"... it might be hard to attract talented AI engineers to live in, say, North Korea ..."

There are other ways to bring talent into North Korea:

"... Choi was abducted and taken to North Korea by the order of Kim Jong-il. While searching for Choi after her abduction, Shin was also abducted and taken to North Korea soon after."

"... In North Korea, Choi and Shin were remarried, at Kim's recommendation.[5] Kim had them make films together ..."

https://en.wikipedia.org/wiki/Choi_Eun-hee#Abduction_and_yea...

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#523

Post by maest »

pgt wrote: post #429
canjobear wrote: post #122

Earlier quoted context omitted.

I think you are underestimating what an advance these models are over previous NLP models in terms of quality. Before GPT-2 we didn't even have models that could reliably generate grammatical sentences. Now we have things that generate coherent (if not beautiful) paragraphs. It seems easy in retrospect, but some of the smartest people around have been working on this for decades.

Is there a term for the casual dismissal of breakthrough technologies and ever-moving goalposts for what is considered impressive?

"God of the gaps"? The original usage is in theology, but the idea is the same.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#526

Post by kunfuu »

bemmu wrote: post #465
joe_the_user wrote: post #99

Earlier quoted context omitted.

If OP article was cherry-picked, the tree must not be very productive. More than cherry-picking, there's the Eliza Effect - it's pretty easy to make people think generated text is intelligent. That text can seem intelligent for a while isn't necessarily impressive at all. https://en.wikipedia.org/wiki/ELIZA_effect

To be honest, personally I had no idea it was generated until the author said so at the end. Makes me worry about my own reading comprehension, but I think what happened was that since it was posted on HN and got upvoted a lot, I simply assumed that anything that I didn't understand was not the writer's fault, but mine. For instance, it was unclear from the post what the bitcoinforum experiment was about, but I just…

The second one doesn't sound like a mistake to me. Someone being able to consistently post so quickly is actually a valid sign of being a bot.

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#529

Post by dorgo »

samvher wrote: post #300
zerocrates wrote: post #262

Earlier quoted context omitted.

What I've never quite gotten is, what's really the risk people are seeing? GPT-2 specifically I remember a great deal of handwringing (or hype) about how dangerous it was. I feel like I even asked this same question here earlier: What's the danger? I hear about "polarization" and so on, but what's this supposed to enable that the bots and trolls and just good old regular people of today don't? Is it just a matter of…

I rely a lot on text for obtaining information and shaping my opinion, and in many cases short form text plays an important role (e.g. here or on reddit). I’m sure I’m not alone in that. This technology can at the very least waste my time, confuse me and hide the content that I’m actually looking for. It looks like it can feasibly generate 2-3 sentence comments that make sense in context, but in an automated way, wit…

Would you consider this comment to have less/no value if you found out that it was generated by a bot? What if quality and information density of automated text surpasses human contributions? Will it still be just spam?

Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin

#530

Post by xsmasher »

imlina wrote: post #214

Now just need a plausibility checking AI to vet GPT-3 outputs so the author doesn’t have to read through 10 versions of his potential blog post.

That's how generative adversarial networks work, right? One neural net to create, another to check if it matches the training data.
Post reply on HN