51–60 of 554 posts
Earlier quoted context omitted.
I saw a demo of a gpt3 designing an app that looked just like Instagram home feed skeleton. While it seem impressive, but until you show me something more obscure, that was nothing to brag about.
Please please please post a link to that video. It sounds super interesting
Earlier quoted context omitted.
I saw a demo of a gpt3 designing an app that looked just like Instagram home feed skeleton. While it seem impressive, but until you show me something more obscure, that was nothing to brag about.
Please please please post a link to that video. It sounds super interesting
Honestly not that impressive since you can get comparable results with a series of regex rules given that there are limited ways to describe your intent e.g. "create a button of colour at the "
I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
* GPT-3 is trained on one
I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
I agree, responses are almost as interesting as GPT-3. And this place has always felt like one of the better when it comes to people reading past the titles!
I'm surprised that GPT-3 understands how to write coherently about GPT-3. Common Crawl, the bulk of GPT-3's training data, was collected even before GPT-2 was published. Maybe the Wikipedia dump they used was recent enough to contain a few references to GPT-2, but that's it. So if GPT-3 never saw any discussion of GPT-3, and probably almost no discussion of GPT-2, in its training data, how does it know what they are?…
Unless you work for open-ai, you've never actually seen GPT3... for all you know for sure it could be some amazing mechanical turk thing postprocessing GPT2 output :)
Earlier quoted context omitted.
> no-one can train GPT-3 in any acceptable time except for those with access to large GPU/ASIC compute power (OpenAI, Microsoft, Google, NVIDIA, etc.) Any state actor has access to large compute power
But it might be hard to attract talented AI engineers to live in, say, North Korea
Earlier quoted context omitted.
> no-one can train GPT-3 in any acceptable time except for those with access to large GPU/ASIC compute power (OpenAI, Microsoft, Google, NVIDIA, etc.) Any state actor has access to large compute power
But it might be hard to attract talented AI engineers to live in, say, North Korea
I published a response today to the sudden hype urging people to temper their expectations for GPT-3 a bit: https://minimaxir.com/2020/07/gpt3-expectations/ GPT-3 is objectively a step forward in the field of AI text-generation, but the current hype on VC Twitter misrepresents the model's current capabilities. GPT-3 isn't magic.
> AI text-generation "Text generation" undersells it a little bit. What are humans except "text generation" machines? Language is the stuff of reason. GPT-3 has demonstrated capabilities that we believed were exclusive to humanity --- humor, logic, sarcasm, cultural references --- in an automatic and generalizable way. It's far more than a "text generation" system. I look forward to seeing what GPT-4 and GPT-5 can do…
"I chose bitcointalk.org as the target environment for my experiments for a variety of reasons: It is a popular forum with many types of posts and posters."
Still, it's very lucid and coherent until the last generated paragraph, not bad...
I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
GPT-3 is a neat party trick. But the things that'll be done with web archives* in the next 20y will make it look like the PDP-8. ~love, a web archivist * GPT-3 is trained on one