Live data from Hacker News

The Harness Is the Thing

scott-fryxell.github.io

31–40 of 105 posts

Re: The Harness Is the Thing

#32
post #18

Earlier quoted context omitted.

It seems there are two distinct groups, one which is doing relatively well with Luna, Deepseek Flash and similar models while other seem to be satisfied only with the state of the art.

I'm ok with not-Fable until I need anything design-related: a nice HTML page, LaTeX typesetting, UI design. Sol is especially incapable of doing anything sensible. Is there any alternative model with design sensibilities?

Kimi K3 is amazing

Re: The Harness Is the Thing

#34
post #3

Reading this really makes me wish that I had a slightly better workflow. I'm really soley dependent of Fable to the point that I don't use other models, and I've already sort of hit a point where I'm running into usage limits every week. I am really living on borrowed time — when Anthropic finally collapses their 50% usage increase at the end of August, I'll definitely be forced to switch my workflow. When that happe…

> Reading this really makes me wish that I had a slightly better workflow. I'm really soley dependent of Fable

Good thing then that you're fully in control of your own actions.

A gift granted to us by being a fully grown adult that is also likely registered to vote.

Meta: There is of course a way to put this less snarky, but that doesn't slap people in the face as hard as they need to be slapped in the face to maybe one day start remembering that they have agency.

Re: The Harness Is the Thing

#36
post #4

Earlier quoted context omitted.

I've been using GPT-5.6 Luna for everything at this point. It is more than enough to do all the work I need to do. You have to lead it by the nose, but if you know where you're going it works really, really well.

It seems there are two distinct groups, one which is doing relatively well with Luna, Deepseek Flash and similar models while other seem to be satisfied only with the state of the art.

Yeah, it's about, do you guide it, or does it guide you.

Re: The Harness Is the Thing

#37
I've been very happy with Luna but my approach is "many bite sized edits" for which models basically hit saturation a year ago.

(I also tried the "let a massive model make massive changes" approach and am still psychologically recovering from the experience. The codebase may never recover!)

Also, Luna and DSV4 Flash seem to be on par now except Luna is faster and cheaper?

Re: The Harness Is the Thing

#38
I use Claude Code, Codex and opencode pretty much interchangeably. I am currently using Claude more this month because (stupidly) I paid for Max ($100) since I have a large client project.

I generally use larger models to plan. All my generated Epics have similar structure. All my repos have similar structure (https://github.com/brainless/akar and https://github.com/brainless/daftprompt are recent examples).

I barely spend time or thought in making prompts. I have a simple text file with a few combinations. They refer all the common files (README, AGENTS, DEVELOP, etc.)

All reference software is cloned locally and the docs mention that. The prompt templates then boil down to research mode (write Epic) or worker mode (write software) or review mode (leave review notes in Epic). That's it.

Many of my harness experiments are about text manipulation, text search, graph on text. Because that is what LLMs are - text processing systems. Cut parts of prompts, cut parts of response, cut parts of user's intent. Join, break into epics/tasks, run with LLMs, repeat.

Re: The Harness Is the Thing

#40
post #37

I've been very happy with Luna but my approach is "many bite sized edits" for which models basically hit saturation a year ago. (I also tried the "let a massive model make massive changes" approach and am still psychologically recovering from the experience. The codebase may never recover!) Also, Luna and DSV4 Flash seem to be on par now except Luna is faster and cheaper?

FWIW I run a clinical analysis backend and directly compared Luna with DSv4 Flash 0731 - DS was a bit ahead, and cheaper even considering it used 40% more tokens.

The exposure to Deepseek made me question the valuation house of cards built on SOTA providers. There are more companies producing competitive and useful models than there are companies producing jet engines for airliners, and not for the lack of trying. China has been trying to make these engines for decades and so far failed (their flagship C919 airliner is using CFM, American/French), but it has produced at least three competitive model companies within 3 years even though they're handicapped by their hardware.

It's simply not that hard, and diminishing returns will, in fact, diminish.

Post reply on HN