Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Can ChatGPT generate fully functional code?

news.ycombinator.com

Post reply on HN
Print view View original

31–40 of 69 posts

Re: Ask HN: Can ChatGPT generate fully functional code?

#31

Post by fvdessen »

prohobo wrote: post #16

First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…

For me the conversational interface is what makes the AI useful as a coding companion, how do you integrate GPT-3 in your workflow ?

Re: Ask HN: Can ChatGPT generate fully functional code?

#33

Post by arcturus17 »

prohobo wrote: post #16

First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…

> First of all, don't use ChatGPT for that

> It's strange to me that people are going crazy over ChatGPT when GPT-3

People are going crazy because of the combination of the capabilities of the model and the UX.

Surely you can appreciate how deploying your own full GPT-3 based solution to assist in code generation is much more complex than going to a web app and typing "code me an Express server".

Re: Ask HN: Can ChatGPT generate fully functional code?

#34

Post by raesene9 »

I've seen some experiments done with using ChatGPT to produce entire websites or programs

https://github.com/pdparchitect/ChatGPT-JobsForBots and https://github.com/pdparchitect/ChatGPT-Pong were two of them.

The author shows all the steps used to generate the programs.

Re: Ask HN: Can ChatGPT generate fully functional code?

#35

Post by prohobo »

stevenhuang wrote: post #20
prohobo wrote: post #16

First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…

That's flat wrong. That is ChatGPT's answer to the difference between ChatGPT and gpt3. ChatGPT does not really know about itself, its data cutoff is from 2021. ChatGPT is trained on a variant of gpt-3.5 (instructgpt), read more here https://openai.com/blog/chatgpt/

Okay, maybe I'm wrong, but the article doesn't explain how ChatGPT compares to GPT-3.

Re: Ask HN: Can ChatGPT generate fully functional code?

#36

Post by prohobo »

fvdessen wrote: post #31
prohobo wrote: post #16

First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…

For me the conversational interface is what makes the AI useful as a coding companion, how do you integrate GPT-3 in your workflow ?

I've just been using the Playground. Also, working on creating a voice activated personal assistant.

Re: Ask HN: Can ChatGPT generate fully functional code?

#37

Post by orisho »

prohobo wrote: post #35
stevenhuang wrote: post #20

Earlier quoted context omitted.

That's flat wrong. That is ChatGPT's answer to the difference between ChatGPT and gpt3. ChatGPT does not really know about itself, its data cutoff is from 2021. ChatGPT is trained on a variant of gpt-3.5 (instructgpt), read more here https://openai.com/blog/chatgpt/

Okay, maybe I'm wrong, but the article doesn't explain how ChatGPT compares to GPT-3.

ChatGPT uses the model text-davinci-003, which was released alongside it. The previous model of the same kind was text-davinci-002, and in a comparison I read, seems to perform much less impressively. So it's not just the chat interface. It's genuinely more impressive in my opinion.

Re: Ask HN: Can ChatGPT generate fully functional code?

#38

Post by prohobo »

orisho wrote: post #37
prohobo wrote: post #35

Earlier quoted context omitted.

Okay, maybe I'm wrong, but the article doesn't explain how ChatGPT compares to GPT-3.

ChatGPT uses the model text-davinci-003, which was released alongside it. The previous model of the same kind was text-davinci-002, and in a comparison I read, seems to perform much less impressively. So it's not just the chat interface. It's genuinely more impressive in my opinion.

Ah that's weird. Using text-davinci-003 in the playground gives very different answers to ChatGPT, and that's with playing with the temperature as well.

Re: Ask HN: Can ChatGPT generate fully functional code?

#39

Post by d4rkp4ttern »

spaceman_2020 wrote: post #23

I've been using it for small blocks of code or specific functions - stuff I'd have to look up documentation or Stackoverflow for. I see it as a productivity booster, not a replacement. You can't tell it to "create a CRUD app", but you can ask it to create a nodejs function that gets all the records from a mongodb database.

Is it better than Copilot with comment-based incremental code writing?

Re: Ask HN: Can ChatGPT generate fully functional code?

#40

Post by spaceman_2020 »

davidkunz wrote: post #25
spaceman_2020 wrote: post #23

I've been using it for small blocks of code or specific functions - stuff I'd have to look up documentation or Stackoverflow for. I see it as a productivity booster, not a replacement. You can't tell it to "create a CRUD app", but you can ask it to create a nodejs function that gets all the records from a mongodb database.

You can ask for a simple example of a CRUD app, here's my code output: const express = require('express') const app = express() // define the model for a user const User = { name: '', email: '' } // create a new user app.post('/users', (req, res) => { const user = Object.assign({}, User, req.body) // save the user to a database, etc. res.send(user) }) // read a list of users app.get('/users', (req, res) => { // retri…

Well that's impressive :)

But of course unless you had programming experience, you would have no way to structure this output correctly and actually take it live

Post reply on HN