Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 is phenomenal at Code

github.com

Post reply on HN
Print view View original

61–70 of 221 posts

Re: GPT-4 is phenomenal at Code

#61

Post by zamnos »

Is it? According to OpenAI's paper

                      GPT-4     GPT-4 (no vision)  GPT-3.5
    Leetcode (easy)   31 / 41   31 / 41           12 / 41
    Leetcode (medium) 21 / 80   21 / 80            8 / 80
    Leetcode (hard)    3 / 45    3 / 45            0 / 45
https://cdn.openai.com/papers/gpt-4.pdf Table 1; page 5.

So it's better than GPT-3.5, but still pretty pathetic at hard Leetcode problems. If your programming job is closer to leetcode easy problems you might be in trouble, but for the real problems that aren't just gluing some libraries together your job is safe.

Re: GPT-4 is phenomenal at Code

#63

Post by primax »

I'd like to start writing something based on GPT to build web scrapers, probably on top of Colly and Gorm. Is there a good resource for learning how to feed external data into GPT?

Re: GPT-4 is phenomenal at Code

#64

Post by stuff20230314 »

sualehasif wrote: post #16
stuff20230314 wrote: post #12

That's cool and all, but can it do "in this existing code, please amend this feature"? Also useful, "please cover this code with meaningful unit tests"?

Definitely. For e.g. you cannot say go to VSCode and add this feature. But, If we point it to the piece of code and ask it to append it and write tests, it does really well. (We want engineers to have control haha.)

...it does really well... As in "ready to commit" or leaving the hard part (review of correctness) to developer?

Re: GPT-4 is phenomenal at Code

#65

Post by wil421 »

ChuckNorris89 wrote: post #25
recuter wrote: post #14

Remember the comments about artists and creatives when DALL-E came out? I remember.

I think my barber and my plumber have safer jobs from automation than average coders.

Let’s play this out. A company fires all the SE’s and GPT-4 takes over their place.

Who will be there to ask the right questions? Middle management?

Who can validate it spit out what you actually want? Project managers?

Who will determine what questions to ask GPT-4? Product owners?

Who will decide what type of tech (language etc…) to ask GPT-4 to write? College grads turned into corporate GPT-4 pushers?

Who will be able to determine business logic based on prior experience? GPT-4?

IMHO, a lot of the hard work for an SE is not the actual coding.

Re: GPT-4 is phenomenal at Code

#66

Post by mjr00 »

recuter wrote: post #14

Remember the comments about artists and creatives when DALL-E came out? I remember.

I remember it being vastly overhyped about how artists were now obsolete, but it really hasn't happened. People have quickly became very attuned to the "AI art style"--humans are excellent at pattern recognition, after all--and if anything, it's made people appreciate how important an artists' individual style and attention to detail is.

Re: GPT-4 is phenomenal at Code

#67

Post by greenthrow »

sualehasif wrote: post #41
greenthrow wrote: post #17

This is cool to see. I'd love to try it out and see how useful it is for me to do my job but I don't think it's likely that I'll be able to do that soon. I think eventually I will be using this every day just like I use lots of other tools.

email us at sualeh@anysphere.co :) We would love for you try it out.

Thanks! Appreciate it. I will reach out to try it for fun, but don't think my employer will be down with using it on our actual code.

Re: GPT-4 is phenomenal at Code

#68

Post by swader999 »

ChuckNorris89 wrote: post #51
swader999 wrote: post #39

Earlier quoted context omitted.

I think we'll all get more productive is all. There's a lot of projects that just weren't economical but now may become so. The bigger disruption will occur when Google, Facebook, Twitter, Reddit etc become useless from all the AI spam that's sure to overwhelm it all.

But here's the question. If these tools make existing devs 10x more productive, why bother hiring new people in the field?

The new people will still work for a little less.

Re: GPT-4 is phenomenal at Code

#69

Post by [deleted] »

nottathrowaway3 wrote: post #27

> is phenomenal at Code Can it - attend bullshit meetings - lick my manager's boot - tell them that their ideas are good but in the masochistic, self-deprecating way they like to hear it from me in Not yet? Darn it, guess my job is safe for now.

[deleted]

Re: GPT-4 is phenomenal at Code

#70

Post by swatcoder »

sublinear wrote: post #23
carapace wrote: post #8

Well, I think I just retired. Even knowing this was coming, it's still a bit unnerving. Sad too, but it's for the best. Let the machines program the machines. Schmidhuber's Gödelmachine. The automatic scientist .

Ugh not this again. Who the hell is running a business where the developers are mere struggling code monkeys who have no other value to the company, would never code review the AI output, and would find it faster to repl a bunch of imprecise prompts instead of just writing the damn code in the first place?

I mean, I’m with you in sentiment, but there are a lot of those business issuing a lot of regular paychecks. It’s a thing.

These AI products are more like shop tools than automated workshops, but even shop tools cut the need for a lot of apprentice and street labor.

Post reply on HN