Live data from Hacker News

Demo of an OpenAI language model applied to code generation [video]

twitter.com

41–50 of 158 posts

Re: Demo of an OpenAI language model applied to code generation [video]

#42
post #38

Can this freaky A.I. also generate the corresponding unit tests? Or, for TDD, generate the unit tests first based on the function name and description. Then, if the dev updates any of those tests, or adds more tests, use that information in auto generating the appropriate code.

Great question, I actually think writing test code is harder than writing the product code.

Re: Demo of an OpenAI language model applied to code generation [video]

#44
post #5

I would much rather have an AI that is capable of interpreting what I say as code. So if I say: Build me a class which computes the larger of two integers. The AI is smart enough to write it.

You should watch the video. It's closer to what you're suggesting than I think you realize.

Re: Demo of an OpenAI language model applied to code generation [video]

#45
post #18

I had trouble accessing the relevant video snippet even after going through the conference registration, so here's a summary. You can view the demo at https://twitter.com/i/broadcasts/1OyKAYWPRrWKb starting around 29:00. It's Sam Altman demoing a massive Open AI model that was trained on GitHub OSS repos using a Microsoft supercomputer. It's not Intellicode, but the host says that they're working on compressing the m…

[deleted]

Re: Demo of an OpenAI language model applied to code generation [video]

#46
How does this do compared to other models? Is this a totally cutting edge result? On the surface, it seems quite impressive, but sans an environment to try it out with, I cannot be entirely sure. Still, this does make me question whether I chose a safe career, haha.

The thing is, I'd really need to see a live demo to see how good this is. Making mistakes is actually kind of a big issue; as most people know, debugging code is harder than writing it. And a lot of the language models which can write impressive-seeming text also generate masses of garbage. There's no way to know whether this was cherrypicked or not.

The mere fact that it can extract meaning from text like this is already really impressive though.

Re: Demo of an OpenAI language model applied to code generation [video]

#47
post #38

Can this freaky A.I. also generate the corresponding unit tests? Or, for TDD, generate the unit tests first based on the function name and description. Then, if the dev updates any of those tests, or adds more tests, use that information in auto generating the appropriate code.

At the end of the chat with OpenAI they mention that their model can be used for generating unit tests as well.

Re: Demo of an OpenAI language model applied to code generation [video]

#48
post #38

Can this freaky A.I. also generate the corresponding unit tests? Or, for TDD, generate the unit tests first based on the function name and description. Then, if the dev updates any of those tests, or adds more tests, use that information in auto generating the appropriate code.

Towards the end of that section, he mentions they have also used it to generate unit tests. I doubt it's doing full TDD, but it seems they are part of the way there.

Re: Demo of an OpenAI language model applied to code generation [video]

#50
post #38

Can this freaky A.I. also generate the corresponding unit tests? Or, for TDD, generate the unit tests first based on the function name and description. Then, if the dev updates any of those tests, or adds more tests, use that information in auto generating the appropriate code.

Towards the end of that section, he mentions they have also used it to generate unit tests. I doubt it's doing full TDD, but it seems they are part of the way there.

That actually sounds bad.
Post reply on HN