I miss the opposite: the old openAI gym and other testbeds. I still don’t know why they shut those down.
What alternatives do people like?
OpenAI API
21–30 of 165 posts
Re: OpenAI API
#22Earlier quoted context omitted.
Not everyone wants to be an admin to their infrastructure. Real existing services like Heroku and Squarespace exist as useful services because even though you might know how to design and build a website from scratch, sometimes you just need something done quickly without too much worrying about details of the system that do not matter for your project at this point. I really don't see how this wouldn't apply to AI p…
That's true, but machine learning models are not twilio or sendgrid, you have to tune them for your use case, monitor their performance and handle the uncertainty of their outputs. Doing that well requires a data scientist and if you have one they will be much more productive iterating on their own models instead of depending on a 3rd party black box.
I'm pretty sure people said the exact same thing about Algolia when it was getting started (you have to tune search for your use case! How could you possibly use a search provider?!?)
Truth about the situation: - Transformers generalize well and don't need much fine tuning - OpenAI can probably fine tune for your use case better than you can - Getting new models into production takes 6 months to a year at companies of this size, if you did have Data Scientists in house, it might just be better to go with a solution like this for velocity - Not every company has the talent to make an in house ML program successful.
Re: OpenAI API
#23Concrete numbers from the various pullouts: > They saw ratings hover around 60% with their original, in-house tech — this improved by 7-8% with GPT-2 — and is now in the 80-90% range with the API. > The F1 score of its crisis classifier went up from .76 to .86, and the accuracy went up to 96%. > With OpenAI, Algolia was able to answer complex natural language questions accurately 4x as often as it was using BERT. I t…
$10m per training run gets me a lot of engineering time to build our own version of this system and lease it to other customers. Just skip one training run and I've got a pretty good team.
Re: OpenAI API
#24Looks like OpenAI is going head to head with huggingface. This makes a lot of sense and it seems they are telegraphing to monetize what they have been doing. It also seems like this is why they don't release their models in a timely manner.
The notable difference is that the base Huggingface library is open source, so you could in theory build something similar or more custom to the OpenAI API internally (which then falls into the typical cost/benefit analysis of doing so).
Re: OpenAI API
#25Whoa -- Speech to bash commands? That's a pretty novel idea to me with my limited awareness of NLP. I could see this same idea in a lot of technical applications -- Provisioning cloud infrastructure, creating a database query.. Very cool!
Re: OpenAI API
#26Earlier quoted context omitted.
I imagine they’re considering offering GPT-3, which would be cost prohibitive to fine-tune for most people. I also I heard inference was too slow to be practical. Perhaps they have some FPGA magic up their Microsoft sleeves.
Nobody is putting these huge models in production, even the smaller transformer models are still too expensive to run for most use cases. With the way the field is moving, GPT-3 will be old news in a month, when more advances are made and open sourced.
Precisely my point. If they could put a model as large as GPT-3 into production (at a reasonable price to the consumer), wouldn’t that be a 10x improvement?
Re: OpenAI API
#27Re: OpenAI API
#28This is what I submitted for beta list: I want to create a software that can generate new code given business case hints, by studying existing open source code and their documentation. I know this is vague, but sounds like what we eventually want for ourselves right?
Remember how Microsoft trained their bot from reddit comments and it went anti human? Well I guess I have to start dropping hints for the skynet in all my repos.
Re: OpenAI API
#29An API that will try to answer any natural language question is a mind blowing idea. This is a universal thinking interface more than an application programming one.
Re: OpenAI API
#30This is incredible. I can't tell how much this is cherry-picked examples vs. revolutionary new tech.