Live data from Hacker News

GPT-4 is phenomenal at Code

github.com

11–20 of 221 posts

Re: GPT-4 is phenomenal at Code

#11
post #4

Any concerns about sending code directly to a third party? I’m very hesitant to use any tool that is sending my assets to the cloud to be used who knows how.

Yes. The privacy concerns are huge. With that said, id use the shit out of this for open source development where privacy is not a concern.

Instead you have legal concerns when you are re-licensing code you don't know where it comes from.

Someone could have published a snippet of code with retained copyright (not FOSS) and GPT-4 slurped it up, splitting it back to you and somehow the law firm representing the author comes across it.

Re: GPT-4 is phenomenal at Code

#13
post #8

Well, I think I just retired. Even knowing this was coming, it's still a bit unnerving. Sad too, but it's for the best. Let the machines program the machines. Schmidhuber's Gödelmachine. The automatic scientist .

Yes, the kinds of people who would write a python program in C++ are in trouble.

Re: GPT-4 is phenomenal at Code

#15
post #4

Any concerns about sending code directly to a third party? I’m very hesitant to use any tool that is sending my assets to the cloud to be used who knows how.

The large tech company I work at explicitly told us not to upload code or any private company info to ChatGPT or similar services. I assume other companies have the same policy.

Re: GPT-4 is phenomenal at Code

#16

That's cool and all, but can it do "in this existing code, please amend this feature"? Also useful, "please cover this code with meaningful unit tests"?

Definitely.

For e.g. you cannot say go to VSCode and add this feature. But, If we point it to the piece of code and ask it to append it and write tests, it does really well. (We want engineers to have control haha.)

Re: GPT-4 is phenomenal at Code

#17
This is cool to see. I'd love to try it out and see how useful it is for me to do my job but I don't think it's likely that I'll be able to do that soon. I think eventually I will be using this every day just like I use lots of other tools.

Re: GPT-4 is phenomenal at Code

#18
I tried having it write some HTML and JS code for a chat app UI. It works amazingly well. I'm legitimately going to have ChatGPT help me write this side project website I've been working on.

Re: GPT-4 is phenomenal at Code

#19

That's cool and all, but can it do "in this existing code, please amend this feature"? Also useful, "please cover this code with meaningful unit tests"?

Yes, it can do both of those things.

I've done a bunch of stuff with ChatGPT where I've pasted in code and asked it to make changes. The main limit there is the token limit - 8,000 I think for ChatGPT - so I'm very much looking forward to experimenting with the increased 32,000 limit when that becomes available.

I write tests for my code using Copilot a bunch - sometimes by pasting in the code I want to test and starting to type tests - it autocompletes them really effectively.

I wrote a bit about that here: https://til.simonwillison.net/gpt3/writing-test-with-copilot

Re: GPT-4 is phenomenal at Code

#20
I'm waiting for copilot that has access to something like language server and instead of just suggesting immediate completions and using open tabs for context it can use LS to pull references for context, suggest file creation, adding code in non trivial places. Then add a chat interface on top. Suddenly I'm really 10x - I would pay hundreds of dollars per month for this if it worked well - it would let me handle at least two or three IC jobs. Next level after that would be getting access to tasks/development board and automatically having that as context.

Copilot and chatgpt are so clunky to work with - they help but it's not groundbreaking - once the workflow gets streamlined there will be a time window where you can leverage your experience to do 10x productivity.

Post reply on HN