Last week I used ChatGPT for the first time for a real world task at work. It was a self-contained lambda function to perform some admin tasks, so it seemed like an ideal fit. Although the experience was good, it's far from the end of programmers. This was my experience: * Although ChatGPT is pretty good at generating code, it kept making simple mistakes such as calling non-existing APIs or introducing bugs. Some of…
I was discussing a bug with a colleague, so for curiosity's sake I decided to plug a similar question into ChatGPT. I was quite impressed with the solution it gave, and interestingly, it had the same subtle bug that our code had. What blew me away is that when I pointed out the bug, ChatGPT fixed the code by itself. On one hand I felt "phew, at least it needed me to point out the bug", but then I thought "I just (perhaps stupidly) provided training data so that down the road ChatGPT would get it right the first time."