Live data from Hacker News

OpenAI Codex

openai.com

21–30 of 181 posts

Re: OpenAI Codex

#21
post #20

I'm still surprised by the approach. I mean, great that it works this well -- but program synthesis is one of those rare domains where you can observe exactly what the outcome is after you generate something. You can see execution traces, variable values, what the JIT produced, etc. And all of this is relatively cheap -- often executing a code snippet should be far cheaper than an extra pass through a giant DNN right…

[deleted]

Re: OpenAI Codex

#22
post #8

I thought OpenAI was originally supposed to be some kind of for-the-good, non-profit institution studying AI and its safe use in particular with an effort to make it more accessible and available to all through more open collaboration. This is cool research, sure; but what happened to making models available for use by others instead of just through some opaque APIs? Maybe I'm just remembering wrong or conflating Ope…

I remember Sam Altman, when asked “How will you make money?”, reply they would ask the AI. I thought it was a fairly creative answer.

It turns out, however, that the way they plan on earning money is much less creative, and more run-of-the-mill SaaS monetization. In a way, I like to believe that a real AI would also end up with such a mundane strategy, as it’s the most likely to actually make them profitable and return money to investors.

Re: OpenAI Codex

#23

I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…

Think bigger. Say I'm starting a startup:

1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done.

2. "Make a shopping page like $URL." Done.

3. "Fill it with data from X and connect with Stripe." Done.

4. ???

5. Profit

Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.

Re: OpenAI Codex

#24

I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…

Think bigger. Say I'm starting a startup: 1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done. 2. "Make a shopping page like $URL." Done. 3. "Fill it with data from X and connect with Stripe." Done. 4. ??? 5. Profit Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.

[deleted]

Re: OpenAI Codex

#25

Earlier quoted context omitted.

That's a really interesting demo. What makes the responses so laggy? Does the model take that long to generate text? You can also experiment with things like repeating the user question or adding pauses like "hmm let's see" to make it less noticeable at least some of the time. Too bad they asked you to pull it. What's the danger they are worried about? Annoying thing from their press releases is how seriously they ta…

It's laggy since it needs to do speech to text, gpt3 text response, then text to speech. Not sure what adds the most latency actually. They only allow gpt3 chatbots if the chatbot is designed to speak only about a specific subject, and literally never says anything bad/negative (and we have to keep logs to make sure this is the case). Which is insane. Their reasoning to me was literally a 'what if' the chatbot "advis…

> But they are so scared of their chatbot saying a bad thing and the PR around that they've removed the possibility of doing anything useful with it.

It's not unreasonable to have checks-and-balances on AI content, and there should be.

However, in my testing of GPT-3's content filter when it was released (it could be improved now), it was very sensitive to the point that it had tons of false positives. Given that passing content filter checks is required for productionizing a GPT-3 app, it makes using the API too risky to use, and part of the reason I'm researching more with train-your-own GPT models.

Re: OpenAI Codex

#26

Earlier quoted context omitted.

That's a really interesting demo. What makes the responses so laggy? Does the model take that long to generate text? You can also experiment with things like repeating the user question or adding pauses like "hmm let's see" to make it less noticeable at least some of the time. Too bad they asked you to pull it. What's the danger they are worried about? Annoying thing from their press releases is how seriously they ta…

It's laggy since it needs to do speech to text, gpt3 text response, then text to speech. Not sure what adds the most latency actually. They only allow gpt3 chatbots if the chatbot is designed to speak only about a specific subject, and literally never says anything bad/negative (and we have to keep logs to make sure this is the case). Which is insane. Their reasoning to me was literally a 'what if' the chatbot "advis…

Eh, I could still see a clearly labeled chatbot on a video game causing a major PR scandal if it says something offensive. Not really worth the risk.

Pretty bad that they took so long to decide on this, though, pulling out the rug from under developers' feet.

Re: OpenAI Codex

#27
post #18

A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…

This stunning. Imagine being able to practice your foreign language lessons this way.

How many languages does GPT3 support at the moment?

Re: OpenAI Codex

#28

I don't understand what is going on, why are people even spending time on this? I think this and copilot and etc are solving a non problem of "we will remove the boring part of programming" by generating a bunch of code, so now it's even more boring to read it and check if it actually does what you want. In the same time zero of the developers I interviewed know how a linked list is laid out in memory, or what is the…

Think bigger. Say I'm starting a startup: 1. "Setup Django, Nginx, and Postgres deployed on a Digital Ocean Ubuntu droplet." Done. 2. "Make a shopping page like $URL." Done. 3. "Fill it with data from X and connect with Stripe." Done. 4. ??? 5. Profit Seems like even a great dev will take 20x the time to do that if the model is able to correctly generate this, even with an error, customization, or two.

but does it really matter, if 20x is 1 week instead of 2 hours?

are startups really that shallow?

Re: OpenAI Codex

#29

A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…

The notion of a toy like a chatbot being "dangerous" is just so ludicrous. The OpenAI folks take themselves way too seriously. Their technology is cool and scientifically interesting, but in the end it's nothing more than a clever parlor trick.

Re: OpenAI Codex

#30

A warning to devs building on OpenAI APIs: We spent months developing a chatbot using GPT3 for our game and released a video showcasing it: https://www.youtube.com/watch?v=nnuSQvoroJo&t=264s Afterwards OpenAI then added GPT3 chatbot guidelines disallowing basically anything like this. We were in communication with them beforehand, but they decided later that any sort of free form chatbot was dangerous. What they allo…

Oh man, I was looking forward to this a ton! Are you thinking to keep working on it with the open source GPT J or something similar by any chance?
Post reply on HN