Earlier quoted context omitted.
Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)
This - it is tremendously valuable to me and I use it all the time at work.
GPT-3 is no longer the only game in town
41–50 of 217 posts
Re: GPT-3 is no longer the only game in town
#42Earlier quoted context omitted.
Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)
Yes I'm used it now but first time it started doing its thing, I wanted to stop and clap for how jaw dropping and amazing this technology is. I was a Jetbrains fan but this thing takes productivity to a whole new level. I really don't think I can go back to my normal programming without it anymore.
Re: GPT-3 is no longer the only game in town
#43Earlier quoted context omitted.
Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)
Yes I'm used it now but first time it started doing its thing, I wanted to stop and clap for how jaw dropping and amazing this technology is. I was a Jetbrains fan but this thing takes productivity to a whole new level. I really don't think I can go back to my normal programming without it anymore.
Re: GPT-3 is no longer the only game in town
#44Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for
They can also all be adapted and fine tuned for other tasks in content classification, search, discovery etc. Think facnial recognition for topics. Want to mine a whole social network for anywhere people are talking about _______ even indirectly with very low false negative rate? You want to fine tune a transformer model.
Bert tends to get used for this more because it is freely available, established and not too expensive to fine tune but i suspect this is what microsoft licensing gpt-3 is all about.
Re: GPT-3 is no longer the only game in town
#45Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for
You can try it yourself - apply for a free API license from OpenAI. If you like to use Common Lisp or Clojure then I have examples in two of my books (you can download for free by setting the price to zero): https://leanpub.com/u/markwatson
Re: GPT-3 is no longer the only game in town
#46Earlier quoted context omitted.
How many % of the time does it produce code that compiles?
The overwhelming majority. Whatever used to take me an hour or two is now a 10-minute task.
Re: GPT-3 is no longer the only game in town
#47Only by analyzing the page title (from the bookmark, not by re-fetching the url) and eventually also the domain name.
Re: GPT-3 is no longer the only game in town
#48Neat to see more models getting closer, thought it appears only one so far has exceeded GPT-3's 175B parameters. That said, what I'm really curious is how those other models stack up against GPT-3 in terms of performance -- does anyone know of any comparisons?
Re: GPT-3 is no longer the only game in town
#49Earlier quoted context omitted.
Yes, this is an old idea (which I really like) but it hasn't really taken off yet. GridCoin was one example, where you solved BOINC problems or RLC that's for more general computation.
It hasn't taken off because it doesn't work. PoW only works for things that are hard to calculate but easy to verify. Any meaningful result is equally hard to verify.
This is very much not true. A central class in complexity is NP whose problems are hard to answer but easy to verify if the answer is yes.
E.g. is there a path visiting all nodes in this graph of length less than 243000? Hard to answer but easy to check any proposed answer.
Re: GPT-3 is no longer the only game in town
#50Earlier quoted context omitted.
>What would a business use it for If you think about business uses you can actually get advices from Jerome Powell, simulated by GPT-3. If someone use GPT-3 to simulate Warren Buffet, he can extract even more value. https://www.institutionalinvestor.com/article/b1tktmhcfdyqsk...
> Interviewer: Are you in favor of a carbon tax? > Mr. Powell: I don’t want to get into the details of taxes. > Interviewer: Are you in favor of a cap and trade system? > Mr. Powell: I don’t want to get into the details of a cap and trade system. > Interviewer: How do you think a global pandemic would impact the financial system? > Mr. Powell: A pandemic will have impact on the economy. It will have an impact on the…