Can LLMs write better code if you keep asking them to “write better code”?
1–10 of 461 posts
Re: Can LLMs write better code if you keep asking them to “write better code”?
#2ChatGPT is really good at writing Arduino code. I say this because with Ruby it's so incredible bad that the majority of examples don't work, even short samples are to hallucinated to actually work. It's so bad I didn't even understand what people mean with using AI to code until I tried a different language.
However on Arduino it's amazing, until the day it forgot to add a initializing method. I didn't notice and neither did she. We've talked about possible issues for at least a hour, I switched hardware, she reiterated every line of the code. When I found the error she said, "oh yes! That's right. (Proceeding with why that method is essential for it to work)" that was so disrespecting in a way that I am still somewhat disappointed and pissed.
Re: Can LLMs write better code if you keep asking them to “write better code”?
#3its best to tell them how you want the code written.
Re: Can LLMs write better code if you keep asking them to “write better code”?
#4The more interesting question IMO is not how good the code can get. It is what must change for the AI to attain the introspective ability needed to say "sorry, I can't think of any more ideas."
Re: Can LLMs write better code if you keep asking them to “write better code”?
#5Something major missing from the LLM toolkit at the moment is that it can't actually run (and e.g. test or benchmark) its own code. Without that, the LLM is flying blind. I guess there are big security risks involved in making this happen. I wonder if anyone has figured out what kind of sandbox could safely be handed to a LLM.
Re: Can LLMs write better code if you keep asking them to “write better code”?
#6I once sat with my manager and repeatedly asked Copilot to improve some (existing) code. After about three iterations he said “Okay, we need to stop this because it’s looking way too much like your code.”
I’m sure there’s enough documented patterns of how to improve code in common languages that it’s not hard to get it to do that. Getting it to spot when it’s inappropriate would be harder.
Re: Can LLMs write better code if you keep asking them to “write better code”?
#7Using the tool in this way is a bit like mining: repeatedly hacking away with a blunt instrument (simple prompt) looking for diamonds (100x speedup out of nowhere). Probably a lot of work will be done in this semi-skilled brute-force sort of way.
Re: Can LLMs write better code if you keep asking them to “write better code”?
#8[deleted]
Re: Can LLMs write better code if you keep asking them to “write better code”?
#9its best to tell them how you want the code written.
What if I want to discover a new better way to write code?
Re: Can LLMs write better code if you keep asking them to “write better code”?
#10Something major missing from the LLM toolkit at the moment is that it can't actually run (and e.g. test or benchmark) its own code. Without that, the LLM is flying blind. I guess there are big security risks involved in making this happen. I wonder if anyone has figured out what kind of sandbox could safely be handed to a LLM.
It'd be great if it could describe the performance of code in detail, but for now just adding a skill to detect if a bit of code has any infinite loops would be a quick and easy hack to be going on with.