It does many mistakes that are only obvious if you know what you're looking at.
Ask HN: Can ChatGPT generate fully functional code?
11–20 of 69 posts
Re: Ask HN: Can ChatGPT generate fully functional code?
#12type "continue" & it will continue where you left off. it has a token cap so it stopped once it filled them.
[deleted]
Re: Ask HN: Can ChatGPT generate fully functional code?
#13Take a look at this: https://www.dropbox.com/s/gq2hkp7w37c5y6q/ai.png?dl=0
It did write incorrect tests for non-Latin characters though.
Re: Ask HN: Can ChatGPT generate fully functional code?
#14type "continue" & it will continue where you left off. it has a token cap so it stopped once it filled them.
Here is the response that I got after the "continue" command and its still incomplete.
Re: Ask HN: Can ChatGPT generate fully functional code?
#15Take a look at this: https://www.dropbox.com/s/gq2hkp7w37c5y6q/ai.png?dl=0
holy cow
Re: Ask HN: Can ChatGPT generate fully functional code?
#16First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002).
ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model.
It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now.
More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-difference-between-chatgpt-and-gpt-3-...
Re: Ask HN: Can ChatGPT generate fully functional code?
#17I gave it a .txt file that i wanted to parse its data into .csv columns. It actually got most of it right but after spending hours prompting it, it never really got everything right.
Its worst nightmare was that there were some nested values in the .txt. What amazed me the most is that pasting the error code from colab into the chat, it recognized the mistake and generated a fix.
That being said, most of the times it would try to fix a logical mistake by overengineering a solution to an error, or it would identify the mistake correctly, explain in natural language what needs to be done (impressive), but then give me the code unchanged.
Re: Ask HN: Can ChatGPT generate fully functional code?
#18First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…
Well, ChatGPT is free for now.
Re: Ask HN: Can ChatGPT generate fully functional code?
#19Try a simple calculator. It will give you the complete code for that. I think there's a set limit on output text so that's why your tic-tac-toe was incomplete. I've asked for the calc in Rust and Python and I got a working app for both. It was simple but the fact that it gave me what I asked for is amazing.
I bet that you could break-up your app into functions and have ChatGPT write each function to get to a bigger program.
It's limited now but I can definitely see the possibilities.
It won't be free forever so we'll have to weight the usefulness vs cost eventually.
Re: Ask HN: Can ChatGPT generate fully functional code?
#20First of all, don't use ChatGPT for that. Use full GPT-3, specifically the code models (ie. code-davinci-002). ChatGPT is a subset & tweak of the full GPT-3 model to make a good chatbot, and it's actually less capable than the full model. It's strange to me that people are going crazy over ChatGPT when GPT-3 has been out for months now. More info on the difference between ChatGPT and GPT-3: https://dev.to/ben/the-dif…
That's flat wrong. That is ChatGPT's answer to the difference between ChatGPT and gpt3. ChatGPT does not really know about itself, its data cutoff is from 2021.
ChatGPT is trained on a variant of gpt-3.5 (instructgpt), read more here https://openai.com/blog/chatgpt/