Sometimes I want to cook a home meal. If I wanted to open a large world class fast food chain, I wouldn't be cooking home meals then. That would be silly. Copilot can help me cook the equivalent of a McDonalds special in terms of software. It's good, I think McDonalds is delicious. But it cannot help me cook a home meal software. It will insist that my home made fries must go in a little red box, and my fish sandwich…
If you prompt an LLM like an architect and feed it code rather than expecting it to write your code, both ChatGPT 4o and Claude 3.7 Sonnet do a great job. Do they mess up? Regularly. But the key is to guide the LLM and not let the LLM guide you, otherwise you'll end up in purgatory.
It takes some time to get used to what types of prompts work. Remember, LLMs are just tools; used in a naive way, they can be a drain, but used effectively they can be great. The typing speed alone is something I could never match.
But just like anything, you have to know what you're doing. Don't go slapping together a bunch of source files that they spit out. Be specific, be firm, tell it what to review first, what's important and what is not. Mention specific algorithms. Detail exactly how you want something to fit together, or describe shortcomings or pitfalls. I'll be damned if they don't get it most of the time.