I'm curious how people are catching subtle bugs or technical debt when the LLM produces something that works but might be unoptimized.
Ask HN: How do you audit LLM code in programming languages you don't know?
1–10 of 19 posts
If you've used Claude Code or similar tools for "vibe-coding" in programming languages you aren't fluent in or that you don't know, how do you validate the performance or architectural quality of the outcome?
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#2I prefer the ancient Chinese science of Oracle Bone divination. You take the scapulae of an ox and copy the PR diff onto the bone using jiǎgǔwén encoding, then throw it in a fire until thermal expansion causes the bone to crack.
You then take a photo of the cracked bone and feed it back to your coding agent, which has been properly trained in interpreting Oracle Bones to extract PR review comments.
If the PR is too big too fit on the bone, you reject it for being too big. If after three rounds of review the bones keep cracking in the same spot, reject the PR. You accept the PR once the bone starts to seep bone marrow before cracking (it will crack first if there are any PR comments left)
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#3You don’t. A JS dev isn’t going to catch an uninitialized variable in C and probably doesn’t even know the damage nasal demons can cause. You either throw more LLMs at it or learn the language.
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#4[dead]
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#5That's the neat part - you don't!
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#6if you audit it, then you're not vibing.
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#7You do a cross analysis.
- Compile it with the maximum number of warnings enabled
- Run linters/analyzers/fuzzers on it
- Ask another LLM to review it
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#8by burying your head in the sand and convincing yourself that the llm doesn't generate any slop.
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#9https://factory.strongdm.ai has some advice I've found useful.
Re: Ask HN: How do you audit LLM code in programming languages you don't know?
#10How can a tree fall in the wood where nobody there?