Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-3 is no longer the only game in town

lastweekin.ai

Post reply on HN
Print view View original

31–40 of 217 posts

Re: GPT-3 is no longer the only game in town

#31

Post by vitus »

DeathArrow wrote: post #23
mrbukkake wrote: post #2

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

>What would a business use it for If you think about business uses you can actually get advices from Jerome Powell, simulated by GPT-3. If someone use GPT-3 to simulate Warren Buffet, he can extract even more value. https://www.institutionalinvestor.com/article/b1tktmhcfdyqsk...

Somehow I don't think that this is quite how Jerome Powell would respond in an interview:

> Interviewer: How do you think a global pandemic would impact the financial system?

> Mr. Powell: A pandemic will have impact on the economy. It will have an impact on the financial system.

> Interviewer: What would the impact be?

> Mr. Powell: If a major pandemic occurred, the economy would be affected, and the financial system would be affected.

Yes, GPT-3 can provide a convincing chatbot, but it shouldn't be confused for domain expertise.

Re: GPT-3 is no longer the only game in town

#33

Post by machiaweliczny »

warning26 wrote: post #3

Neat to see more models getting closer, thought it appears only one so far has exceeded GPT-3's 175B parameters. That said, what I'm really curious is how those other models stack up against GPT-3 in terms of performance -- does anyone know of any comparisons?

There's Wu Dao 2.0 and Google has 2 models with 1T+ params.

Re: GPT-3 is no longer the only game in town

#34

Post by sva_ »

DeathArrow wrote: post #23
mrbukkake wrote: post #2

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

>What would a business use it for If you think about business uses you can actually get advices from Jerome Powell, simulated by GPT-3. If someone use GPT-3 to simulate Warren Buffet, he can extract even more value. https://www.institutionalinvestor.com/article/b1tktmhcfdyqsk...

> Interviewer: Are you in favor of a carbon tax?

> Mr. Powell: I don’t want to get into the details of taxes.

> Interviewer: Are you in favor of a cap and trade system?

> Mr. Powell: I don’t want to get into the details of a cap and trade system.

> Interviewer: How do you think a global pandemic would impact the financial system?

> Mr. Powell: A pandemic will have impact on the economy. It will have an impact on the financial system.

> Interviewer: What would the impact be?

> Mr. Powell: If a major pandemic occurred, the economy would be affected, and the financial system would be affected.

Maybe I'm a bit harsh on GPT-3, but I'm not nearly as fascinated by this kind of output as the author.

Re: GPT-3 is no longer the only game in town

#35

Post by DeathArrow »

mrbukkake wrote: post #2

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

Chat bots are an usage. I think you might use it for customer support.

One example of GPT-3 powered chat bot: https://www.quickchat.ai/emerson

Re: GPT-3 is no longer the only game in town

#36

Post by ghoomketu »

crubier wrote: post #4
mrbukkake wrote: post #2

Can anyone tell me what the value of GPT-3 actually is other than generating meaningless prose? What would a business use it for

Have you heard of GitHub copilot ? It’s based on GPT3 and I can tell you one thing: it does not generate meaningless prose (90% of the time)

Yes I'm used it now but first time it started doing its thing, I wanted to stop and clap for how jaw dropping and amazing this technology is.

I was a Jetbrains fan but this thing takes productivity to a whole new level. I really don't think I can go back to my normal programming without it anymore.

Re: GPT-3 is no longer the only game in town

#37

Post by evergrande »

DeathArrow wrote: post #9

People were blaming cryptocurrencies miners for the prices of GPUs, when in fact it was the AI researchers who bought all the GPUs. :D I wonder what if somebody designs an electronic currency rewarded as payment for general GPU computations instead of just computing hashes? You pay some $, to train your model and the miner gets some coins. Every one is happy, electricity is not wasted and the GPUs gets used for a rea…

First the electricity morality police came for crypto and I said nothing.

Then they came for AI, video games, HN...

Re: GPT-3 is no longer the only game in town

#38

Post by GhettoComputers »

>However, the ability of people to build upon GPT-3 was hampered by one major factor: it was not publicly released. Instead, OpenAI opted to commercialize it and only provide access to it via a paid API. This made sense given OpenAI’s for profit nature, but went against the common practice of AI researchers releasing AI models for others to build upon. So, since last year multiple organizations have worked towards creating their own version of GPT-3, and as I’ll go over in this article at this point roughly half a dozen such gigantic GPT-3 esque models have been developed.

Seems like aside from Eleuther.ai you can’t use the models freely either, correct me if I’m wrong.

Re: GPT-3 is no longer the only game in town

#40

Post by inglor »

skybrian wrote: post #24
inglor wrote: post #20

Earlier quoted context omitted.

This - it is tremendously valuable to me and I use it all the time at work.

What do you use it for?

Coding, I actually had to forbid it today in a course I teach because it solves all the exercises :) (given unit tests with titles students needed to fill those tests in)
Post reply on HN