Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API

beta.openai.com

Post reply on HN
Print view View original

141–150 of 165 posts

Re: OpenAI API

#141

Post by julien_c »

canjobear wrote: post #140
d_burfoot wrote: post #125

In NLP there is a very clear and powerful new paradigm: train a HUGE language model using vast amounts of raw text. Then to solve the problem of interest, either fine-tune the model by training on your specific dataset (usually quite small), or 0/1-shot the learning somehow. The crucial question is : is this paradigm viable for OTHER types of data? My hypothesis is YES. If you train a HUGE image model using vast quan…

The pretraining approach was used in vision for years before it was successful in NLP.

Not really on unsupervised/self-supervised data though, right?

(nor on the same scale of corpora, as far as I can tell)

Re: OpenAI API

#142

Post by fudged71 »

mcrider wrote: post #25

Whoa -- Speech to bash commands? That's a pretty novel idea to me with my limited awareness of NLP. I could see this same idea in a lot of technical applications -- Provisioning cloud infrastructure, creating a database query.. Very cool!

Can they train it to write regex commands too? That would be useful

Re: OpenAI API

#143

Post by jklm »

FeepingCreature wrote: post #91
Barrin92 wrote: post #88

Earlier quoted context omitted.

I know that it isn't. That's part of the problem. There is no attempt to generate some sort of structure that can be interpreted semantically and reasoned about by the model. The model just operates on the input superficially and statistically. That's why there has been virtually no progress on trivial tasks such as answering: "I took the water bottle out of the backpack so that it would be [lighter/handy]" What is l…

Have you tried feeding this to GPT and seeing if it continues it in a way that reveals understanding? It sounds like you're saying "It doesn't work because it can't work", but you haven't actually shown that it doesn't work.

FWIW, I fed this into AIDungeon (running on OpenAI) and got this back: “The bottle is definitely lighter than the pack because you can throw it much further away than you can carry the pack. You continue on into the night and come to an intersection.”

Re: OpenAI API

#144

Post by dalys »

I just sent in a request to join the waiting list, for the company I work at, Kognity. The potential for this in the EdTech field is mindblowingly amazing!

There are a few good examples of educational help on the list but it's really only scratching the surface.

I'm really excited and hope Kognity and EdTech in general can use this for even more value-full (both for students and teachers) tasks soon.

Re: OpenAI API

#147

Post by YeGoblynQueenne »

wildermuthn wrote: post #36

In one of their examples, they note “They saw ratings hover around 60% with their original, in-house tech — this improved by 7-8% with GPT-2 — and is now in the 80-90% range with the API.” Bloomberg reports the API is based on GPT-3 and “other language models”. If that’s true, this is a big deal, and it epitomizes OpenAI’s namesake. The largest NLP models require vast corporate resources to train, let alone put into…

How is this "democratization"? OpenAI trains a model, then they make it available through an API. You have no say in what that model is trained on or how (other than to say whether they can use your data- but not how), neither can you modify the model according to your needs. And of course, with no ability to modify the product you're buying you have no opportunity to innovate. You can wrap it up in a different kind of application, sure, but the nature and number of applications that it can be wrapped up in is restricted by the abilities of the model and therefore is entirely dependent on the choices made by OpenAI.

Imagine MS saying they "democratised" operating systems because, hey, you can buy their binaries, so everyone can use their operating system. Compare that kind of "democratisation" with open source oSs.

No, the truth is that as more and more resources are necessary to wring the last few drops of performance out of the current generation of deep neural net models it is only large, well-funded companies that have the resources to innovate - and everyone else is forced to follow in their wake. Any expectations that progress would lead to "democratisation" of deep neural networks research has gone out the window.

Re: OpenAI API

#148

Post by say_it_as_it_is »

gdb wrote: post #76
say_it_as_it_is wrote: post #66

OpenAI started off wide-eyed and idealistic but it made the mistake of taking on investors for a non-profit mission. A non-profit requires sponsors, not investors. Investors have a fiduciary responsibility to maximize profits, not achieve social missions of open AI for all.

OpenAI LP, our "capped-profit" entity which has taken investment, has a fiduciary duty to the OpenAI Charter: https://openai.com/blog/openai-lp/

Mind changed. Keep leading the way!

Re: OpenAI API

#149

Post by google234123 »

jfoster wrote: post #41
google234123 wrote: post #33

Earlier quoted context omitted.

Why would you say this?

I presume it's reference to OpenAI's patent pledge: > Researchers will be strongly encouraged to publish their work, whether as papers, blog posts, or code, and our patents (if any) will be shared with the world. I'm not sure if it's ever been publicly elaborated on. https://openai.com/blog/introducing-openai/

Still seems like a low effort, bad hot-take.

Re: OpenAI API

#150

Post by sendbitcoins »

freediver wrote: post #128
organicfigs wrote: post #122

Earlier quoted context omitted.

fwiw my best friends are SE Asian (not Chinese), white, black, and Mexican. I didn't feel this photo is as equally representative of that diversity. I'm not making a case it has any obligation to do so, just noting that it impacted my decision to not apply here a while ago.

If it had people of different color of skin but all men, would that bother you (no women)? Or if it had different color of skin but all of them were Christian? ( no other religions) Or different color of skin but all Canadians would that bother you? (No other nationalities) As a European I am much more used to diversity meaning national or religious diversity. Still getting used to this notion of it mainly been used…

Its just code for too many whites.
Post reply on HN