Live data from Hacker News

I'm tired of fixing customers' AI generated code

medium.com

91–100 of 345 posts

Re: I'm tired of fixing customers' AI generated code

#91
post #63

Earlier quoted context omitted.

But he made a good living out of it, so in the end it was a good idea?

It certainly puts a ceiling on a career. And I'd argue it probably gave him a pretty rough shelf life. At some point he has to understand what he's doing. Unless he's so good at selling his services he can consistently find new clients. And if that's the case, he'd probably kill it in sales.

I'll bet the ceiling is CTO.

Re: I'm tired of fixing customers' AI generated code

#92
post #55

I had a related episode at work when my coworker asked me why his seemingly trivial 10 line piece of code was misbehaving inexplicably. It turned out he had two variables `file_name` and `filename` and used one in place of another. I asked him how he ended up with such code, he said he used copilot to create it. Using code from a generative AI without understanding what it does is never a good idea.

Copilot wouldn't make a typo. He just made that up and / or broke the code himself.

LOL, are you kidding me? LLMs including the gpt family copilot uses are very good at sneaking in these sorts of thing.

Re: I'm tired of fixing customers' AI generated code

#93

Earlier quoted context omitted.

What percentage of web traffic today would you say is composed of bits that the user--if they bothered to inspect it--would prefer to not have anything to do with? I'd say it's more than half. Computers treat people like garbage all the time.

you're right, but I have a hard time picturing the computer as having emotions to be able to treat me like garbage in the first place. you won't rm the file? sudo rm file! the computer could fight back and say access denied still because of extended attributes, but for some reason I don't equate poorly written software as being treated like garbage. I always imagine some hapless programmer is doing the best they coul…

I'm similarly sympathetic when I come across a buggy implementation. It's malicious design that I'm objecting to. But I suppose it's a bit silly to say that it's the computer that's treating me like garbage. It's just that someone else is in control of my computer, and they're treating me like garbage.

Re: I'm tired of fixing customers' AI generated code

#94
post #63
post #60

Earlier quoted context omitted.

I knew a guy that made a good living as a freelance web developer decades ago. He would pretty much just copy and paste code from tutorials or stack overflow and had no real idea how anything worked. Using code without understanding it is never a good idea, it doesn’t need to be from AI for that to be true.

But he made a good living out of it, so in the end it was a good idea?

He may have made a good living, but his customer / employer bought low quality code with lots of tech debt.

That business model only works until customers are sophisticated enough to understand tech debt. In the future, more customers will be less willing to pay the same good wages for low quality code.

Re: I'm tired of fixing customers' AI generated code

#95
post #55

I had a related episode at work when my coworker asked me why his seemingly trivial 10 line piece of code was misbehaving inexplicably. It turned out he had two variables `file_name` and `filename` and used one in place of another. I asked him how he ended up with such code, he said he used copilot to create it. Using code from a generative AI without understanding what it does is never a good idea.

Sounds like javascript "code". A normal language with proper type system would not allow that.

Re: I'm tired of fixing customers' AI generated code

#96
I've been saying for a while now that there's an absolute gold mine waiting for people who want to specialize in fixing AI generated applications.

A lot of businesses are going to either think they can have generative AI create all of their apps with the help of a cousin of the wife of the accountant, or they unknowingly contract a 10x developer from Upwork or alike who uses generative AI to create everything. Once they realize how well that's working out, the smart ones will start from scratch, the not-so-smart will attempt to fix it.

Develop a reputation for yourself for getting companies out of that pickle, and you can probably retire early.

Re: I'm tired of fixing customers' AI generated code

#98

Why don't you use AI to provide support? I'm serious actually. This sounds like something AI can do really well.

I'm a bit torn. My first thought was "If the current state of the art LLMs made the mistakes it's unlikely an LLM would be able to correct them." But I'm not sure that's true if the support LLM (chat bot) is given very specific instructions so as to limit the possible answers. Still I think that's gonna break down pretty quick for other reasons. Maybe the chat bot can recognize a botched request and even suggest a fi…

> I'm a bit torn. My first thought was "If the current state of the art LLMs made the mistakes it's unlikely an LLM would be able to correct them."

But, I mean, that doesn't make sense even for humans, right? 99% of the errors I make, I can easily correct myself because they're trivial. But you still have to go through the process of fixing them, it doesn't happen on its own. Like, for instance, just now I typoed "stil" and had to backspace a few letters to fix it. But LLMs cannot backspace (!), so you have to put them into a context where they feel justified in going back and re-typing their previous code.

That's why it's a bit silly to make LLM code, try to run it, see an error and immediately run to the nearest human. At least let the AI do a few rounds of "Can you spot any problems or think of improvements?" first!

Re: I'm tired of fixing customers' AI generated code

#99
post #55

I had a related episode at work when my coworker asked me why his seemingly trivial 10 line piece of code was misbehaving inexplicably. It turned out he had two variables `file_name` and `filename` and used one in place of another. I asked him how he ended up with such code, he said he used copilot to create it. Using code from a generative AI without understanding what it does is never a good idea.

Sounds like javascript "code". A normal language with proper type system would not allow that.

I don’t see how typing relates to this.

Re: I'm tired of fixing customers' AI generated code

#100
post #92

Earlier quoted context omitted.

Copilot wouldn't make a typo. He just made that up and / or broke the code himself.

LOL, are you kidding me? LLMs including the gpt family copilot uses are very good at sneaking in these sorts of thing.

Show me 1 example.
Post reply on HN