Live data from Hacker News

What is GPT-3? written in layman's terms

tinkeredthinking.com

1–10 of 70 posts

Re: What is GPT-3? written in layman's terms

#4

Just wrote about something similar and what we can learn about GPT-3 inputs. Applicable for lots of domains but written to product managers. https://productsolving.substack.com/p/openais-gpt-3-will-cha...

I'm curious how long this prompting UI into language models like GPT-3 will continue. It's so fiddly and imprecise and unpredictable. It's better than nothing, of course, but there's a lot of art in it.

Re: What is GPT-3? written in layman's terms

#5
One thing I will say after seeing GPT-3 running live is that somehow the examples that you see trotted about in various articles never really seem to capture the spirit of the thing. Interacting with it directly and exploring the universe behind the prompt is one of the more profound computing experiences I've ever had.

Re: What is GPT-3? written in layman's terms

#7
"Generate text that could believably have been written by a human" is a task we're getting very good at. I'm curious how far it extends towards concrete applications. When can we start using it to fill functionality gaps between the functions of a human-coded framework?

Re: What is GPT-3? written in layman's terms

#8
> GPT-3 continuation: A confused voice came from inside. When I opened the door, the person that looked back at me was Hayama Hayato. Why was Hayama, who I only shared memories of me playing soccer with, in my room at this hour of the night? That question immediately flew out from my mouth.

[I knew that name felt familiar](https://oregairu.fandom.com/wiki/Hayato_Hayama). Does that mean GPT-3 was trained on an arbitrary, huge database of text? I wonder how copyright applies here.

Re: What is GPT-3? written in layman's terms

#9
post #8

> GPT-3 continuation: A confused voice came from inside. When I opened the door, the person that looked back at me was Hayama Hayato. Why was Hayama, who I only shared memories of me playing soccer with, in my room at this hour of the night? That question immediately flew out from my mouth. [I knew that name felt familiar]( https://oregairu.fandom.com/wiki/Hayato_Hayama ). Does that mean GPT-3 was trained on an arbit…

> Does that mean GPT-3 was trained on an arbitrary, huge database of text?

Yes, 500 billion words, for a model with model 175 billion parameters.

Re: What is GPT-3? written in layman's terms

#10

Great introduction to GPT-3 and machine learning for non-technical people. Interesting implications/possible use cases described at the end, including therapy and regulatory capture.

GPT-3 probably has thousands of different skills like these two, we just haven't explored it much yet.
Post reply on HN