[flagged]
Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
181–190 of 247 posts
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#182[dead]
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#183I, like many nerds of the same stripe, have a dragon's hoard of every PC component I've owned in the last 20 years. I've attached as much of it to my homelab as is practical, but there's still a pile of GPUs from the last decade plus. So I decided to load up everything with more then 3GB of VRAM into various machines on the network. Anything that could conceivably run an LLM of any utility. I've been experimenting wi…
Even though they arent Nvidia GPUs I wonder if setting up a swarm of Intel GPUs would be worthwhile for a similar setup, more VRAM, more diverse models.
Using OpenVINO and a supported model can get you surprisingly far...
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#184I do all my development as a longish running pipeline that mimics how I used to write software.
There is a high-level plan, it gets decomposed into steps that get performed sequentially. If during a step something occurs that challenges the original assumptions, the remaining steps can be reconfigured or the implementation stopped.
Well, I guess it's more rigorous than me, because it does a lot of quality checking along the way and if course, in the end.
This is the most boring approach to this work as you can imagine. But, after running this process hundreds of times and tuning it, today I can do about 10-20 PRs a day that are often quite good. I manually review and manually test and as models and my pipeline have improved the % of PRs that require zero human intervention after the initial planning is getting higher. Maybe 50%. For the other half, it's good, but there are often glaring bugs, especially for UI/UX stuff.
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#185I'm using LLMs as a search engine replacement. The coding is all me. Writing the code was never the bottleneck.
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#186That's how I code nowadays: 1. Start a session. 2. Grill my requirements. 3. Write an ADR, then either start implementing or separate into pieces. 4. Review the code on pyor.review, compared to Github, Pyor allows me to categorize the files and changes then review the important stuff and skim the noise it identifies. 5. Since I can do local reviews with Pyor, I can do that with Claude and feed back my comments to be…
Based on your comment, I assume you use Matt Pocock’s skills, is that correct? If so, have you compared it to obra’s superpowers?
YES! and I already love them.
haven't heard of obra’s superpowers, will check them out.
Thanks.
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#187I'm using what I call "hermetic agents", where completely sandboxed agents write code and tests from the same specification, where the code writer can't see the test and the test writer can't see the code. The idea is that we can get better quality this way (by avoiding confirmation bias between code and tests). It is more painful to set up however, since you have to distill a spec and guides that the agent would nor…
This is similar to how our college CS problem sets were graded. We were given a spec, and we had to implement a program that conformed to it. We had access to 70% of the test suite during development, and another 30% was hidden and only evaluated after submission. We were graded out of 100. It was effective at making you think about the problem and anticipate what tests might be missing. I can see how this would be e…
The interesting twist here is that the test writer can also be wrong, the QA agent assigns blame when the implementation disagrees with a test case, and it’s not always going to be the implementation’s fault.
Makes me wonder if there should be problems for CS students where given a spec and an interface, but not an actual implementation, they write the tests instead.
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#188I'm using what I call "hermetic agents", where completely sandboxed agents write code and tests from the same specification, where the code writer can't see the test and the test writer can't see the code. The idea is that we can get better quality this way (by avoiding confirmation bias between code and tests). It is more painful to set up however, since you have to distill a spec and guides that the agent would nor…
do you mind sharing the more specific setup or agent framework? Hermes? LangChain? DIY?
I work at Google, so it’s antigravity agents using Blaze (like Bazel) to configure their context, including DAG-style dependencies on other hermetic agent outputs, what specific tool calls they can make, and their communication channels (they can send feedback to agents backwards on the DAG). Otherwise this is completely DIY (antigravity does a lot of the heavy lifting, so nothing fancy accept for custom sandboxing).
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#189I've been experimenting with making AI generate literate code. The goal is to have the AI produce a bunch of prose alongside the code. A lot of context for the purpose and design of what you are doing usually gets thrown away, but with literate programming you can save it. And this way I can have some hope of understanding the code being created. I've liked it so far. I am using a literate programming project I built…
[deleted]
Re: Ask HN: Is anyone experimenting with different ways of using LLMs for coding?
#190I'm using what I call "hermetic agents", where completely sandboxed agents write code and tests from the same specification, where the code writer can't see the test and the test writer can't see the code. The idea is that we can get better quality this way (by avoiding confirmation bias between code and tests). It is more painful to set up however, since you have to distill a spec and guides that the agent would nor…
[flagged]