Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-3 APIs are now in public beta

openai.com

Post reply on HN
Print view View original

91–100 of 163 posts

Re: GPT-3 APIs are now in public beta

#91

Post by KarlKemp »

badestrand wrote: post #34
schleck8 wrote: post #27

Earlier quoted context omitted.

It also makes sense https://artificialintelligence-news.com/2020/10/28/medical-c...

GPT-3 is just a tool. If a product that uses it messes up you can hardly blame it on the tool but rather on that product or the company developing it (here Nabla).

It really doesn’t matter what it ‘is’ or if it makes sense to speak of things in moral categories. There are plenty of ‘tools’ that are/should be restricted, from guns to Tucker Carlson.

It can obviously have some effect on the so-called ‘real world’, or people wouldn’t pour money into developing & using it. It would be a unique feat to be powerful with no chance of any of the effects being harmful.

From there, it’s just arithmetics: what harms and benefits do we expect with what probabilities, and how does this change depending on the distribution scheme?

Re: GPT-3 APIs are now in public beta

#92

Post by ritz_labringue »

dave_sullivan wrote: post #82
fenomas wrote: post #3

Looks neat, but note that OpenAI is basically an App Store model - whatever you make with it cannot be shown to more than five people unless OpenAI has reviewed and explicitly approved your project. And their usage guidelines are pretty narrow - "open-ended chatbots" are explicitly disallowed, for example. > https://beta.openai.com/docs/going-live > https://beta.openai.com/docs/usage-guidelines/use-case-guide...

I don't know why anyone is still paying attention to Open AI's offerings. Use GPT Neo. Use Huggingfaces. Use colab or bare metal or any cloud provider. Open AI's offering is bringing literally nothing to the table that doesn't exist already. Their publications are good (albeit missing important details), but everyone working there was publishing anyway so it's not like this research wouldn't happen without Open AI ex…

Doesn't it cost hundreds of thousands of dollars just to train GPT-3 ? If so, that seems like a good reason to use a "managed" GPT-3.

Re: GPT-3 APIs are now in public beta

#93

Post by dave_sullivan »

ritz_labringue wrote: post #92
dave_sullivan wrote: post #82

Earlier quoted context omitted.

I don't know why anyone is still paying attention to Open AI's offerings. Use GPT Neo. Use Huggingfaces. Use colab or bare metal or any cloud provider. Open AI's offering is bringing literally nothing to the table that doesn't exist already. Their publications are good (albeit missing important details), but everyone working there was publishing anyway so it's not like this research wouldn't happen without Open AI ex…

Doesn't it cost hundreds of thousands of dollars just to train GPT-3 ? If so, that seems like a good reason to use a "managed" GPT-3.

Yes, but they didn't release the model after training and you can't take your weights with you if you finetune their model.

GPT Neo was trained at similar expense, and they released the weights. Use that.

Re: GPT-3 APIs are now in public beta

#94

Post by ricardobeat »

prometheon1 wrote: post #67
fenomas wrote: post #3

Looks neat, but note that OpenAI is basically an App Store model - whatever you make with it cannot be shown to more than five people unless OpenAI has reviewed and explicitly approved your project. And their usage guidelines are pretty narrow - "open-ended chatbots" are explicitly disallowed, for example. > https://beta.openai.com/docs/going-live > https://beta.openai.com/docs/usage-guidelines/use-case-guide...

This seems like a difficult topic, I remember when the first GPTs came out everyone was worried how it would flood the internet with fake news (first example I could find: https://news.ycombinator.com/item?id=19833094 ). This review process seems like a reasonable solution to this problem, and personally I can't think of a better one, can you?

You may have not noticed yet, but something like one in five websites you visit are already using ML to generate “news” summaries. Especially in economy and sports.

Re: GPT-3 APIs are now in public beta

#95

Post by ritz_labringue »

dave_sullivan wrote: post #93
ritz_labringue wrote: post #92

Earlier quoted context omitted.

Doesn't it cost hundreds of thousands of dollars just to train GPT-3 ? If so, that seems like a good reason to use a "managed" GPT-3.

Yes, but they didn't release the model after training and you can't take your weights with you if you finetune their model. GPT Neo was trained at similar expense, and they released the weights. Use that.

Thanks ! Didn't know that. Isn't it also very expensive to run ?

Re: GPT-3 APIs are now in public beta

#96

Post by favourable »

Anyone know something similar to GPT but isn't really 'AI' but more a blackbox algorithm that you don't have to train, and can spit out blogposts given a few bits of initial input?

For example, let's say I wanted to generate an article about 'why the sky is blue'. Couldn't I just say to the program: 'Yes, use Wikipedia as reference material', 'Include 3-4 images with captions too', etc

I imagine such a tool is in use, it's just not possible to know what bloggers use it, since such a tool could be abused to create blogspam on a scale never seen before. In other words: with great power comes great responsibility.

Re: GPT-3 APIs are now in public beta

#97

Post by favourable »

Traubenfuchs wrote: post #63

What the hell is their problem? Why not sell it in an mostly uncontrolled fashion to maximize revenue, marketshare, fame, economy of scale, etc.? I am offended by the idea of people being scared of text produced by AI, text that is ultimately inferior to text produced by professional humans.

> text that is ultimately inferior to text produced by professional humans

Well that depends on whether you train GPT-3 on text written by known professionals doesn't it? Obviously if you train it on hate speech, it will spit out really soul crushing stuff. You have to bake in healthy discourse to it for it to really shine.

Re: GPT-3 APIs are now in public beta

#99

Post by damvigilante »

dave_sullivan wrote: post #93
ritz_labringue wrote: post #92

Earlier quoted context omitted.

Doesn't it cost hundreds of thousands of dollars just to train GPT-3 ? If so, that seems like a good reason to use a "managed" GPT-3.

Yes, but they didn't release the model after training and you can't take your weights with you if you finetune their model. GPT Neo was trained at similar expense, and they released the weights. Use that.

First part is correct, the second part is not. GPT Neo is a 2.7B param model, the largest GPT is 175B (they have various flavours, up to 175B). I appreciate the sentiment and what ElutherAI is doing with GPT Neo, but there is no open source equivlenet of the full GPT-3 available for the public to use. Hopefuly it's just a matter of time.

Re: GPT-3 APIs are now in public beta

#100

Post by CJefferson »

starklevnertz wrote: post #47
kreeben wrote: post #44

Earlier quoted context omitted.

I recall OpenAI openly stating that they don't trust us to do non-nefarious things with their APIs and that's why they've been restricted. You're saying it's because their AI is an asshole?

Can be an asshole sometimes. Quite a lot actually. If you ask it to respond in a conversation about …. well pretty much any nasty topic you can think of, it’ll join in whole heartedly. Hard to think of how prevent that. I bet they’ve thought alot about the problem. How do you prevent AI being an A grade jerk.

In my experience it's worse than that's, it's easy to set off by using any of a number of trigger words.

Many uses of the word "black" for example (even if you are just talking about a black notebook) make it start using racial stereotypes.

Post reply on HN