Live data from Hacker News

A coder considers the waning days of the craft

newyorker.com

431–440 of 1001 posts

Re: A coder considers the waning days of the craft

#431
> At one point, we wanted a command that would print a hundred random lines from a dictionary file. I thought about the problem for a few minutes, and, when thinking failed, tried Googling.

No offence to the author but given that this stopped them in their tracks I choose to ignore their programming related opinions.

Re: A coder considers the waning days of the craft

#432

I have a simple front-end test that I give to junior devs. Every few months I see if ChatGPT can pass it. It hasn’t. It can’t. It isn’t even close. It answers questions confidently but with subtle inaccuracies. The code that it produces is the same kind of non-sense that you get from recent bootcamp devs who’ve “mastered” the 50 technologies on their eight page résumé. If it’s gotten better, I haven’t noticed. Self-d…

If you feel comfortable doing so, would you mind the sharing the front-end test you give to junior devs and ChatGPT?

Not gonna happen. I don’t want scrapeable answers out there, I want to see ChatGPT cross this little Rubicon on its own.

Re: A coder considers the waning days of the craft

#433
post #52

I have been having the following debate with my friend who does AI and neural network stuff: Him: Coding will soon be obsolete, it will all be replaced by chatgpt-type code gen. Me: OK but the overwhelming majority of my job as a "senior engineer" is about communication, organizational leadership, and actually understanding all the product requirements and how they will interface with our systems. Yes, I write code,…

CEOs will be replaced before software engineers.

I don't think you know what a CEO does.

Re: A coder considers the waning days of the craft

#434

I have a simple front-end test that I give to junior devs. Every few months I see if ChatGPT can pass it. It hasn’t. It can’t. It isn’t even close. It answers questions confidently but with subtle inaccuracies. The code that it produces is the same kind of non-sense that you get from recent bootcamp devs who’ve “mastered” the 50 technologies on their eight page résumé. If it’s gotten better, I haven’t noticed. Self-d…

Just like the author suggests, sometimes you have to tailor your question to ChatGPT, for it to succeed.

I’ve given it so many hints. So many nudges. If it was an interview I would have bounced it.

Re: A coder considers the waning days of the craft

#435
post #276
post #54

Earlier quoted context omitted.

How would this anyone be able to evaluate whether the program they requested is correct or not? Automatic program generation from human language really feels like the same problem with machine translation between human languages. I have an elementary understanding of French and so when I see a passage machine translated into French (regardless of software, Google Translate or DeepL) I cannot find any mistakes; I may…

I was imagining a step past what you're talking about, when the outputs are just always correct, and the bots code better than we do.

"Always" correct is a very high bar and likely unattainable. It seems much more likely that the amount of errors will trend downwards but never quite reach zero. How could it be otherwise? AIs are not magic god-machines, they have a limited set of information to work with just like the rest of us (though it might be larger than humans could handle) and sometimes the piece of information is just not known yet.

Let's say that in a few years the amount of correct code becomes 99% instead of ~80%. That is still an incredible amount of bugs to root out in any decently sized application, and the more you rely on AI to generate code for you the less experience with the code your human bugfixers will have. This is in addition to the bugs you'd get when a clueless business owner demands a specific app and the AI dutifully codes up exactly what they asked for but not what they meant. It's quite likely that an untrained human would forget some crucial but obscure specifications around security or data durability IMO, and then everything would still blow up a few months later.

Re: A coder considers the waning days of the craft

#436
I used chatgpt4 recently for two projects. One was a success, the other a complete failure.

In the first project I asked it to help me build a one page ui with html and css, it did great! I know a lot about html and css, so I was able to ask for what I wanted and help it debug.

For the second project I wanted what I thought was a simple threejs animation of an object following a line in a scene. I know very little about threejs and graphics in general. I spent hours wrestling with chatgpt to get this working, but I just got what looked like meaningless non-working code to me. So I took time to learn about threejs, did a few chapters of a course, and came back to the problem. And all of the sudden I had new vocabulary I could use to ask chatgpt what I wanted. And I got pretty close to what I wanted, but not quite. I suspect if I keep learning about threejs and how graphics work I’ll get there.

I don’t think this is the death of our craft, but definitely a big turning point for how we build and use software.

Re: A coder considers the waning days of the craft

#437

Earlier quoted context omitted.

If you feel comfortable doing so, would you mind the sharing the front-end test you give to junior devs and ChatGPT?

Not gonna happen. I don’t want scrapeable answers out there, I want to see ChatGPT cross this little Rubicon on its own.

Just to be clear: You are testing with GPT-4 right?

Re: A coder considers the waning days of the craft

#438

I have a simple front-end test that I give to junior devs. Every few months I see if ChatGPT can pass it. It hasn’t. It can’t. It isn’t even close. It answers questions confidently but with subtle inaccuracies. The code that it produces is the same kind of non-sense that you get from recent bootcamp devs who’ve “mastered” the 50 technologies on their eight page résumé. If it’s gotten better, I haven’t noticed. Self-d…

What sort of questions do you ask out of curiosity?

I don’t want scrapeable answers out there, I want to see ChatGPT cross this little Rubicon on its own.

Vaguely: Questions that most people think they know the correct answers to but, in my experience, don’t.

Re: A coder considers the waning days of the craft

#439
post #295
post #238

I don't see it - and by that I don't mean I don't think AI can write good code and get better over time. I just don't see how it would work as a workflow to replace (most) devs by AI. If I take a junior programmer's task, say, creating CRUD endpoints. Describing the requirement in a way that matches exactly what I want will probably take more time that doing the coding assisted by something like copilot. Can we reall…

I’ve spent a long time in the public sector digitalisation in Denmark and where every other “no-code/low-code” or whatever you call the tools that claim to not require programmers have failed miserably GPT is succeeding. Yes, yes, I know some of you sell these tools and some of you have even been very successful in that effort but in my anecdotal experience from 98 municipalities, it’s never once worked, not for long…

What you're describing is really about empowering users and pushing code where it was not possible before due to cost - so basically confirming efficiency paradox.

Re: A coder considers the waning days of the craft

#440

Earlier quoted context omitted.

> I wanted some way of calculating the sum of a geometric series without having the series in actual cells. There are simple explicit formulas for this.

yeah, sumproduct on google docs was the thing it kept suggesting, but not in a way that worked for the thing I wanted. I found a way around it in the end, but I feel I wasted 30 mins trying to get ChatGPT to understand what I wanted and give me something that actually worked.

\sum_{i=0}^n x^i (the sum of all terms x^i as i ranges from 0 to n, inclusive) = (x^{n+1} - 1)/(x-1).

Or, if n is positive infinity, you assume that |x| If you need the sum from x^m to x^n, that's equal to the sum from 0 to n minus the sum from 0 to (m-1).

You can derive the formula yourself without difficulty:

         sum = 1 + x + x^2 + ... + x^n
    (sum)(x) =     x + x^2 + ... + x^n + x^{n+1}

    (sum)(x) - sum =  x^{n+1} - 1
    (sum)(x-1)     =  x^{n+1} - 1
    (sum)          = (x^{n+1} - 1)/(x-1)
Post reply on HN