Live data from Hacker News

How I program with LLMs

crawshaw.io

191–200 of 342 posts

Re: How I program with LLMs

#191
post #185

Earlier quoted context omitted.

The one that does not convert C# at all and asks you to just optimize it in C# instead (and to use the appropriate build option) :D

I’m converting game logic from C# to UE5 C++. So far made great progress using ChatGPT4o and o1

Do you find these working out better for you than Claude 3.5 Sonnet? So far I've not been a fan of the ChatGPT models' output.

Re: How I program with LLMs

#192
post #187

I definitely respect David's opinion given his caliber, but pieces like this make me feel strange that I just don't have a burning desire to use them. Like, yesterday I made some light changes to a containerized VPN proxy that I maintain. My first thought wasn't "how would Claude do this?" Same thing with an API I made a few weeks ago that scrapes a flight data website to summarize flights in JSON form. I knew I woul…

I think there's a big selection bias on hackernews that you wouldn't get elsewhere. There's still "elite" software developers I see who really aren't into the whole LLM tooling space. I found use in the autocomplete and search workflows that the author mentioned but I stopped using these tools, out of curiosity for things were before. It turns out I don't need it to be productive and I too probably enjoy working more without it.

Re: How I program with LLMs

#193
post #179
post #88

Earlier quoted context omitted.

> That he says LLMs make him more productive at all as a hands-on developer, especially around first drafts on a new idea, means a lot to me personally. There is likely to be a great rift in how very talented people look at sharper tools. I've seen the same division pop up with CNC machines, 3d printers, IDEs and now LLMs. If you are good at doing something, you might find the new tool's output to be sub-par over wha…

Intersting. So engineers that like to iterate and explore are more likely to like LLMs. Whereas engineers that like have a more rigid specific process are more likely to dislike LLMs.

[dead]

Re: How I program with LLMs

#194
post #185

Earlier quoted context omitted.

I’m converting game logic from C# to UE5 C++. So far made great progress using ChatGPT4o and o1

Do you find these working out better for you than Claude 3.5 Sonnet? So far I've not been a fan of the ChatGPT models' output.

I find ChatGPT better with UE4/5 C++ but they are very close.

Biggest advantage is the o1 128k context. I can one shot an entire 1000 line class where normally I’d have to go function by function with 4o.

Re: How I program with LLMs

#195
post #52

One interesting bit of context is that the author of this post is a legit world-class software engineer already (though probably too modest to admit it). Former staff engineer at Google and co-founder / CTO of Tailscale. He doesn't need LLMs. That he says LLMs make him more productive at all as a hands-on developer, especially around first drafts on a new idea, means a lot to me personally. His post reminds me of an…

I have also many years of programming experience and find myself strongly "accelerated" by LLMs when writing code. But, if you think at it, it makes sense that many seasoned programmers are using LLMs better. LLMs are a helpful tool, but also a hard-to-use tool, and in general it's fair to think that better programmers can do a better use of some assistant (human or otherwise): better understanding its strengths, ide…

I completely agree that communication skills are critical in extracting useful work or insight from LLMs. The analogy for communicating with people is not far-fetched. Communicating successfully with a specific person requires an understanding of their strengths and weaknesses, their tendencies and blind spots. The same is true for communicating with LLMs.

I have actually found that from a documentation point of view, querying LLMs has made me better and explaining things to people. If, given the documentation for a system or API, a modern LLM can't answer specific questions about how to perform a task, a person using the same documentation will also likely struggle. It's proving to be a good way to test the effectiveness of documentation, for humans and for LLMs.

Re: How I program with LLMs

#196
post #187

I definitely respect David's opinion given his caliber, but pieces like this make me feel strange that I just don't have a burning desire to use them. Like, yesterday I made some light changes to a containerized VPN proxy that I maintain. My first thought wasn't "how would Claude do this?" Same thing with an API I made a few weeks ago that scrapes a flight data website to summarize flights in JSON form. I knew I woul…

[deleted]

Re: How I program with LLMs

#197
post #183
post #154

Earlier quoted context omitted.

> proprietary code outside the network Thought exercise: what would seriously happen if you did let some of your proprietary code outside your network? Oddly enough, 75% of the people writing code on HN probably have their companies code stored in GitHub. So there already is an inherent trust factor with GH/MSFT. As another anecdote - Twitch's source code got leaked a few years back. Did Twitch lose business because…

> Thought exercise: what would seriously happen if you did let some of your proprietary code outside your network Lawsuits? Lawful terminations? Financial damages?

Huh? No, i'm saying, what potential damage does an organization have? Not the individual who may leak data outside your network.

Re: How I program with LLMs

#198
post #197
post #183

Earlier quoted context omitted.

> Thought exercise: what would seriously happen if you did let some of your proprietary code outside your network Lawsuits? Lawful terminations? Financial damages?

Huh? No, i'm saying, what potential damage does an organization have? Not the individual who may leak data outside your network.

Those are risks both for the individual and for the company when there are contracts in place with third parties involving code sharing.

Other risks include leaking industrial secrets that may significantly damage company business or benefit competitors.

Re: How I program with LLMs

#199
post #20

The killer feature about LLMs with programming in my opinion is autocomplete (the simple copilot feature). I can probably be 2-3x more productive as I'm not typing (or thinking much). It does a fairly good job pulling in nearby context to help it. And that's even without a language server. Using it to generate blocks of code in a chat like manner in my opinion just never works well enough in the domains I use it on.…

The autocomplete is mostly a nusance and maybe low percentage of the time it does right.

I thought so too. Until I worked with a client who doesn't allow the use of LLM tools, and I had to turn my Copilot off. That's when I realized how much I'd grown to rely on it despite the headaches.

Re: How I program with LLMs

#200
post #6

Earlier quoted context omitted.

If you don’t mind me asking: which popular LLM(s) have you been using for this and how are you providing the code base into the context window?

Not OP but Aider provides a repo map to the LLM as context, which consists of the directory tree, filenames, and important symbols in each file. It can use the popular LLMs as well as Ollama. https://aider.chat/docs/repomap.html Aider hosts a leaderboard that rates LLMs on performance, including a section on refactoring. https://aider.chat/docs/leaderboards/refactor.html

AI generated images can be good, and even reasonable to use for branding. Slapping an image right at the top of the page that says "Abstract Synxex Tree" with a meaningless graph and an absolutely expressionless and useless humanoid robot is a great way to immediately lose my interest in anything they have to say though. The homepage would be more interesting as a wall of text.
Post reply on HN