I'm still surprised by the approach. I mean, great that it works this well -- but program synthesis is one of those rare domains where you can observe exactly what the outcome is after you generate something. You can see execution traces, variable values, what the JIT produced, etc. And all of this is relatively cheap -- often executing a code snippet should be far cheaper than an extra pass through a giant DNN right…
OpenAI Codex
21–30 of 181 posts
Re: OpenAI Codex
#22I thought OpenAI was originally supposed to be some kind of for-the-good, non-profit institution studying AI and its safe use in particular with an effort to make it more accessible and available to all through more open collaboration. This is cool research, sure; but what happened to making models available for use by others instead of just through some opaque APIs? Maybe I'm just remembering wrong or conflating Ope…
It turns out, however, that the way they plan on earning money is much less creative, and more run-of-the-mill SaaS monetization. In a way, I like to believe that a real AI would also end up with such a mundane strategy, as it’s the most likely to actually make them profitable and return money to investors.
Re: OpenAI Codex
#23I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…
1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done.
2. "Make a shopping page like $URL." Done.
3. "Fill it with data from X and connect with Stripe." Done.
4. ???
5. Profit
Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.
Re: OpenAI Codex
#24I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…
Think bigger. Say I'm starting a startup: 1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done. 2. "Make a shopping page like $URL." Done. 3. "Fill it with data from X and connect with Stripe." Done. 4. ??? 5. Profit Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.
Re: OpenAI Codex
#25Earlier quoted context omitted.
That's a really interesting demo. What makes the responses so laggy? Does the model take that long to generate text? You can also experiment with things like repeating the user question or adding pauses like "hmm let's see" to make it less noticeable at least some of the time. Too bad they asked you to pull it. What's the danger they are worried about? Annoying thing from their press releases is how seriously they ta…
It's laggy since it needs to do speech to text, gpt3 text response, then text to speech. Not sure what adds the most latency actually. They only allow gpt3 chatbots if the chatbot is designed to speak only about a specific subject, and literally never says anything bad/negative (and we have to keep logs to make sure this is the case). Which is insane. Their reasoning to me was literally a 'what if' the chatbot "advis…
It's not unreasonable to have checks-and-balances on AI content, and there should be.
However, in my testing of GPT-3's content filter when it was released (it could be improved now), it was very sensitive to the point that it had tons of false positives. Given that passing content filter checks is required for productionizing a GPT-3 app, it makes using the API too risky to use, and part of the reason I'm researching more with train-your-own GPT models.
Re: OpenAI Codex
#26Earlier quoted context omitted.
That's a really interesting demo. What makes the responses so laggy? Does the model take that long to generate text? You can also experiment with things like repeating the user question or adding pauses like "hmm let's see" to make it less noticeable at least some of the time. Too bad they asked you to pull it. What's the danger they are worried about? Annoying thing from their press releases is how seriously they ta…
It's laggy since it needs to do speech to text, gpt3 text response, then text to speech. Not sure what adds the most latency actually. They only allow gpt3 chatbots if the chatbot is designed to speak only about a specific subject, and literally never says anything bad/negative (and we have to keep logs to make sure this is the case). Which is insane. Their reasoning to me was literally a 'what if' the chatbot "advis…
Pretty bad that they took so long to decide on this, though, pulling out the rug from under developers' feet.
Re: OpenAI Codex
#27A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…
This stunning. Imagine being able to practice your foreign language lessons this way.
Re: OpenAI Codex
#28I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…
Think bigger. Say I'm starting a startup: 1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done. 2. "Make a shopping page like $URL." Done. 3. "Fill it with data from X and connect with Stripe." Done. 4. ??? 5. Profit Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.
are startups really that shallow?
Re: OpenAI Codex
#29A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…
Re: OpenAI Codex
#30A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…