Live data from Hacker News

LLMs work best when the user defines their acceptance criteria first

blog.katanaquant.com

11–20 of 460 posts

Re: LLMs work best when the user defines their acceptance criteria first

#11
post #5
post #4

Earlier quoted context omitted.

Have you tried describing to Claude what it is? The more the detail the better the result. At some point it does become easier to just do it yourself.

Most people just forget to tell it "make it quick" and "make no mistake"

That's kind of foolish IMO. How can an open ended generic and terse request satisfy something users have in mind?

Re: LLMs work best when the user defines their acceptance criteria first

#14
That's very impressive. Your LLM actually wrote a correct code for a full relational database on the first try, like it takes 2.5 seconds to insert 100 rows but it stores them correctly and select is pretty fast. How many humans can do this without a week of debugging? I would suggest you install some profiling tools and ask it to find and address hotspots. SQL Lite had how long and how many people to get to where it is?

Re: LLMs work best when the user defines their acceptance criteria first

#15
post #9

I tried to make Claude Code, Sonnet 4.6, write a program that draws a fleur-de-lis. No exaggeration it floundered for an hour before it started to look right. It's really not good at tasks it has not seen before.

LLMs are really bad at anything visual, as demonstrated by pelicans riding bicycles, or Claude Plays Pokémon. Opus would probably do better though.

How could they be any good at visuals? They are trained on text after all.

Re: LLMs work best when the user defines their acceptance criteria first

#19

I tried to make Claude Code, Sonnet 4.6, write a program that draws a fleur-de-lis. No exaggeration it floundered for an hour before it started to look right. It's really not good at tasks it has not seen before.

Considering that a fleur-de-lis involves somewhat intricate curves, I think I'd be pretty happy with myself if I could get that task done in an hour.

Given a harness that allows the model to validate the result of its program visually, and given the models are capable of using this harness to self correct (which isn't yet consistently true), then you're in a situation where in that hour you are free to do some other work.

A dishwasher might take 3 hours to do for what a human could do in 30 minutes, but they're still very useful because the machine's labor is cheaper than human labor.

Post reply on HN