Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API

beta.openai.com

Post reply on HN
Print view View original

31–40 of 165 posts

Re: OpenAI API

#31

Post by krallistic »

wildermuthn wrote: post #26
m_ke wrote: post #15

Earlier quoted context omitted.

Nobody is putting these huge models in production, even the smaller transformer models are still too expensive to run for most use cases. With the way the field is moving, GPT-3 will be old news in a month, when more advances are made and open sourced.

Precisely my point. If they could put a model as large as GPT-3 into production (at a reasonable price to the consumer), wouldn’t that be a 10x improvement?

GPT-3 isn't a 10X improvement. (At least from everything we know so far.)

Re: OpenAI API

#32

Post by antris »

m_ke wrote: post #18
antris wrote: post #11

Earlier quoted context omitted.

Not everyone wants to be an admin to their infrastructure. Real existing services like Heroku and Squarespace exist as useful services because even though you might know how to design and build a website from scratch, sometimes you just need something done quickly without too much worrying about details of the system that do not matter for your project at this point. I really don't see how this wouldn't apply to AI p…

That's true, but machine learning models are not twilio or sendgrid, you have to tune them for your use case, monitor their performance and handle the uncertainty of their outputs. Doing that well requires a data scientist and if you have one they will be much more productive iterating on their own models instead of depending on a 3rd party black box.

Not a data scientist myself, but plenty of data scientists in a consultancy company that I used to work in said that they have to implement variants of a limited set of models over and over again, because they couldn't reuse code and infrastructure. The project contracts demanded that all IP created by the consultant is the property of the client. This even caused some of the data scientists to lose motivation, because the job wasn't challenging to them intellectually as it involved setting up the same stuff again and again. Very rarely would their actual expertise be needed in the job.

I am not sure if this particular service solves the problem for them in any way, but to my ear it sounds like there is a need for code and infrastructure reuse in the data scientists domain that is ripe for innovation.

Re: OpenAI API

#34

Post by agakshat »

It’s been a long time coming, but I am curious to see how OpenAI’s research output is directed and impacted by market forces.

Re: OpenAI API

#35

Post by minimaxir »

Since the demos on this page use zero-shot learning and the used model has a 2020-05-03 timestamp, that implies this API is using some form of GPT-3: https://news.ycombinator.com/item?id=23345379 (EDIT: the accompanying blog post confirms that: https://openai.com/blog/openai-api/ )

Recently, OpenAI set the GPT-3 GitHub repo to read-only: https://github.com/openai/gpt-3

Taken together, this seems to imply that GPT-3 was more intended for a SaaS such as this, and it's less likely that it will be open-sourced like GPT-2 was.

Re: OpenAI API

#36

Post by wildermuthn »

In one of their examples, they note “They saw ratings hover around 60% with their original, in-house tech — this improved by 7-8% with GPT-2 — and is now in the 80-90% range with the API.”

Bloomberg reports the API is based on GPT-3 and “other language models”.

If that’s true, this is a big deal, and it epitomizes OpenAI’s namesake. The largest NLP models require vast corporate resources to train, let alone put into production. Offering the largest model ever trained (with near-Turing results for some tasks) is a democratization of technology that would otherwise have been restricted to well-funded organizations.

Although the devil will be in the details of pricing and performance, this is a step worthy of respect. And it bodes well for the future.

Re: OpenAI API

#37

Post by jfoster »

benatkin wrote: post #27
jfoster wrote: post #13

Earlier quoted context omitted.

Elon is no longer part of OpenAI. Microsoft invested $1b. https://en.wikipedia.org/wiki/OpenAI

Does this mean Microsoft isn't going to sue their customers for patent infringement?

Microsoft's stake in OpenAI doesn't seem to be publicly known.

> Exactly what terms Microsoft and OpenAI have agreed on with this $1 billion investment isn’t clear.

https://www.theverge.com/2019/7/22/20703578/microsoft-openai...

Re: OpenAI API

#38

Post by nickswalker »

mcrider wrote: post #25

Whoa -- Speech to bash commands? That's a pretty novel idea to me with my limited awareness of NLP. I could see this same idea in a lot of technical applications -- Provisioning cloud infrastructure, creating a database query.. Very cool!

Cool indeed! While language-to-code (where code is a regular, general-purpose language) has only recently started to be workable, text-to-SQL has been a long running application/research area for semantic parsing.

Some interesting papers and datasets:

NL2Bash: https://arxiv.org/abs/1802.08979

Spider: https://yale-lily.github.io/spider

Re: OpenAI API

#39

Post by wildermuthn »

minimaxir wrote: post #35

Since the demos on this page use zero-shot learning and the used model has a 2020-05-03 timestamp, that implies this API is using some form of GPT-3: https://news.ycombinator.com/item?id=23345379 (EDIT: the accompanying blog post confirms that: https://openai.com/blog/openai-api/ ) Recently, OpenAI set the GPT-3 GitHub repo to read-only: https://github.com/openai/gpt-3 Taken together, this seems to imply that GPT-3 w…

But since the resources required for training such a model are only available to well-funded entities, it seems like offering the model as an API while releasing the original source-code is the best practical method of getting the model into the hands of people who would otherwise not have access?
Post reply on HN