Earlier quoted context omitted.
I'm already dreading all the SEO spam it will lead to.
At some point the SEO spam will become so good that it will become interesting content
One day, we might even reach full-on https://xkcd.com/810/
GPT-3 Explorer
21–30 of 30 posts
Re: GPT-3 Explorer
#22[deleted]
Re: GPT-3 Explorer
#23Earlier quoted context omitted.
"OpenAI" == Orwellian DoubleSpeak Its literally one of the most closed projects in existence. The fact they call it "OpenAI" is an insult.
You know about it, so it's definitely not "one of the most closed projects in existence." It is perhaps one of the more exclusive and overly-hyped projects.
I think the word 'open' was meant to imply open source, not to distinguish between covert ai ops and public ai ops. In that case I think they haven't done enough to make it open to the public.
Re: GPT-3 Explorer
#24This is cool! Excited to try it.
Although the API is already pretty experimentation and REPL-friendly. I recorded a video here of the development experience: https://twitter.com/amasad/status/1286813984159444992
Re: GPT-3 Explorer
#25Earlier quoted context omitted.
with enough resource you can recreate what the paper describes. I'm still not sure if this stuff useful to sell as a service though
You could also just steal OpenAI's cluster in a midnight heist, that might be easier.
There are multiple groups working on reimplementations of GPT-3. It's not that difficult, just requires a certain level of compute resources which a lot of BigCos and large organizations have on tap already.
Re: GPT-3 Explorer
#26Earlier quoted context omitted.
I'm more curious to see what happens when single developers are able to launch products which are vastly better than existing solutions, using just a couple days of effort.
1) Big Corp approaches the single dev saying that Famous Boss of Big Corp is impressed by his project and would like to hear more about it and maybe acquire his project 2) Single dev shares secret sauce (if necessary) during due diligence 3) Big Corp makes a super low offer 4) Big Corp puts 2 engineers on it to copy the result 5) Big Corp is now Bigger Corp, and single dev is still single.
Yes, this is exactly how it will go down I think. Somewhere I read a great analysis which said this was the opposite of "disruptive innovation", but instead this type of innovation will primarily reinforce the positions of the incumbents.
Re: GPT-3 Explorer
#27Does anyone know if they'll ever release the models for GPT-3 so we can train/re-train then ourselves? Or is GPT-3 so general that it doesn't need retraining?
Re: GPT-3 Explorer
#28Does anyone know if they'll ever release the models for GPT-3 so we can train/re-train then ourselves? Or is GPT-3 so general that it doesn't need retraining?
I don’t know if they will release the models, but are you sure you can train a 170 billion parameter model? Last I heard it’s around 500GB, which would require serious infrastructure.
Re: GPT-3 Explorer
#29Does anyone know if they'll ever release the models for GPT-3 so we can train/re-train then ourselves? Or is GPT-3 so general that it doesn't need retraining?
I don’t know if they will release the models, but are you sure you can train a 170 billion parameter model? Last I heard it’s around 500GB, which would require serious infrastructure.
What's interesting with machine learning is that in a few years time algorithms get efficient enough to train the same quality models on commodity hardware. At the same time organizations are always a few years ahead :(
Re: GPT-3 Explorer
#30If GPT-3 was trained on the Internet and even if some information is publicly available, then solution described might be somehow legally protected.
Does GPT-3 recognises that?
Can I request a share in selling of GPT-3 license if I prove that uses my solutions?