Live data from Hacker News

GPT-3 is no longer the only game in town

lastweekin.ai

11–20 of 217 posts

Re: GPT-3 is no longer the only game in town

#11

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

You can prompt GPT-3 in ways that make it perform various tasks such as text classification, information extraction, etc... Basically you can force that "meaningless prose" into answers to your questions.

You can use this instead of having to train a custom model for every specific task.

Re: GPT-3 is no longer the only game in town

#12

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

While the generation is fun and even suitable for some use cases, I'm particularly interested in its ability to take in language and use it for downstream tasks.

A good example is DALL-E[0]. Now, what's interesting to me is the emerging idea of "prompt engineering" where once you spend long enough with a model, you're able to ask it for some pretty specific results.

This gives us a foothold in creating interfaces whereby you can query things using natural language. It's not going to replace things like SQL tomorrow (or maybe ever?) but it certainly is promising.

[0] https://openai.com/blog/dall-e/

Re: GPT-3 is no longer the only game in town

#13
post #6
post #4

Earlier quoted context omitted.

Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)

How many % of the time does it produce code that compiles?

From my anecdotal experience, the vast majority of the time (90+%).

Re: GPT-3 is no longer the only game in town

#14

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

Automatic generation of positive fake customer reviews on Amazon, landing pages about topics that redirect to attack and ad sites, fake "journalism" with auto-generated articles mixed with genuine press releases and viral marketing content, generating fake user profiles and automated karma farming on social media sites, etc. etc.

Re: GPT-3 is no longer the only game in town

#15
post #6
post #4

Earlier quoted context omitted.

Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)

How many % of the time does it produce code that compiles?

The overwhelming majority. Whatever used to take me an hour or two is now a 10-minute task.

Re: GPT-3 is no longer the only game in town

#16

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

You can try it yourself - apply for a free API license from OpenAI. If you like to use Common Lisp or Clojure then I have examples in two of my books (you can download for free by setting the price to zero): https://leanpub.com/u/markwatson

Re: GPT-3 is no longer the only game in town

#17
post #6

Earlier quoted context omitted.

How many % of the time does it produce code that compiles?

From my anecdotal experience, the vast majority of the time (90+%).

Interesting. Is there any constraint built into the model that makes this possible? E.g. grammar, or semantics of the language? Or is it all based on deep learning only?

Re: GPT-3 is no longer the only game in town

#18

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

It's good for the university-industrial-business complex - people writing papers about a model they can't even run themselves. It practically prints money in journal articles, travel per diem, and conference honorariam, not even counting the per-API call rates.

Re: GPT-3 is no longer the only game in town

#19

People were blaming cryptocurrencies miners for the prices of GPUs, when in fact it was the AI researchers who bought all the GPUs. :D I wonder what if somebody designs an electronic currency rewarded as payment for general GPU computations instead of just computing hashes? You pay some $, to train your model and the miner gets some coins. Every one is happy, electricity is not wasted and the GPUs gets used for a rea…

Yes, this is an old idea (which I really like) but it hasn't really taken off yet. GridCoin was one example, where you solved BOINC problems or RLC that's for more general computation.

Re: GPT-3 is no longer the only game in town

#20
post #4

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)

This - it is tremendously valuable to me and I use it all the time at work.
Post reply on HN