Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API

beta.openai.com

Post reply on HN
Print view View original

11–20 of 165 posts

Re: OpenAI API

#11

Post by antris »

m_ke wrote: post #4

I guess Sama plans on manufacturing growth metrics by forcing YC companies to pretend that they're using this. Generic machine learning APIs are a shitty business to get into unless you plan on hiring a huge sales team and selling to dinosaurs or doing a ton of custom consulting work, which doesn't scale the way VCs like it to. Anybody who will have enough know how to use their API properly can jus grab an open sourc…

Not everyone wants to be an admin to their infrastructure. Real existing services like Heroku and Squarespace exist as useful services because even though you might know how to design and build a website from scratch, sometimes you just need something done quickly without too much worrying about details of the system that do not matter for your project at this point. I really don't see how this wouldn't apply to AI projects as well.

I could make a much better site coding my own website from scratch and setting up servers myself, but for some projects I wouldn't even think about it that way, because using Heroku or Squarespace I can save a LOT of time and get the results I need much quicker.

Re: OpenAI API

#15

Post by m_ke »

wildermuthn wrote: post #6
m_ke wrote: post #4

I guess Sama plans on manufacturing growth metrics by forcing YC companies to pretend that they're using this. Generic machine learning APIs are a shitty business to get into unless you plan on hiring a huge sales team and selling to dinosaurs or doing a ton of custom consulting work, which doesn't scale the way VCs like it to. Anybody who will have enough know how to use their API properly can jus grab an open sourc…

I imagine they’re considering offering GPT-3, which would be cost prohibitive to fine-tune for most people. I also I heard inference was too slow to be practical. Perhaps they have some FPGA magic up their Microsoft sleeves.

Nobody is putting these huge models in production, even the smaller transformer models are still too expensive to run for most use cases.

With the way the field is moving, GPT-3 will be old news in a month, when more advances are made and open sourced.

Re: OpenAI API

#16

Post by mrmonkeyman »

brainless wrote: post #10

This is what I submitted for beta list: I want to create a software that can generate new code given business case hints, by studying existing open source code and their documentation. I know this is vague, but sounds like what we eventually want for ourselves right?

If said AI will also maintain it.

Re: OpenAI API

#17

Post by zitterbewegung »

Looks like OpenAI is going head to head with huggingface.

This makes a lot of sense and it seems they are telegraphing to monetize what they have been doing. It also seems like this is why they don't release their models in a timely manner.

Re: OpenAI API

#18

Post by m_ke »

antris wrote: post #11
m_ke wrote: post #4

I guess Sama plans on manufacturing growth metrics by forcing YC companies to pretend that they're using this. Generic machine learning APIs are a shitty business to get into unless you plan on hiring a huge sales team and selling to dinosaurs or doing a ton of custom consulting work, which doesn't scale the way VCs like it to. Anybody who will have enough know how to use their API properly can jus grab an open sourc…

Not everyone wants to be an admin to their infrastructure. Real existing services like Heroku and Squarespace exist as useful services because even though you might know how to design and build a website from scratch, sometimes you just need something done quickly without too much worrying about details of the system that do not matter for your project at this point. I really don't see how this wouldn't apply to AI p…

That's true, but machine learning models are not twilio or sendgrid, you have to tune them for your use case, monitor their performance and handle the uncertainty of their outputs. Doing that well requires a data scientist and if you have one they will be much more productive iterating on their own models instead of depending on a 3rd party black box.

Re: OpenAI API

#19

Post by Grimm1 »

m_ke wrote: post #18
antris wrote: post #11

Earlier quoted context omitted.

Not everyone wants to be an admin to their infrastructure. Real existing services like Heroku and Squarespace exist as useful services because even though you might know how to design and build a website from scratch, sometimes you just need something done quickly without too much worrying about details of the system that do not matter for your project at this point. I really don't see how this wouldn't apply to AI p…

That's true, but machine learning models are not twilio or sendgrid, you have to tune them for your use case, monitor their performance and handle the uncertainty of their outputs. Doing that well requires a data scientist and if you have one they will be much more productive iterating on their own models instead of depending on a 3rd party black box.

Except the point of these larger transformer models is they generalize well over a wide range of domains or only require a small amount of transfer learning for really specific domains.

I'd say they're perfect candidates for the API as a service model.

Post reply on HN