Live data from Hacker News

What Is a Harness?

earendil.com

31–40 of 200 posts

Re: What Is a Harness?

#31

Earlier quoted context omitted.

> Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” I really though this comment was a satire ...

Sadly, many people have bought into the cult that LLMs will lead to AGI. I guess if that is your worldview then all this babbling about new frontiers makes more sense. They probably used an LLM to come up with this bizarre metaphor.

Did I even mention AGI? All I’m saying is that we’re hitting a plateau with how good models are while harnesses are untapped potential. And with Pi, you can swap models like electricity companies. Yes for now, the electricity is better with some companies but this will stabilize.

And no I came up with the metaphor all on my own, send me the chat of you getting the LLM to come up with it. Why not argue based on merit instead of strawman and ad hominem attacks?

Re: What Is a Harness?

#33

Earlier quoted context omitted.

i think its the opposite. claude code apparently removed hundreds of lines of system prompt because its not relavent anymore with newer models. also i think its hard to build general harnesses if they were trained on specific harness architecture.

Yes but Pi has had a minimal system prompt since inception. Skills and Pi extensions let you make a hyper specific harness for specific use cases. For general conversation, harnesses are overkill most times. There’s evidence of harnesses making a smaller, weaker model perform better than SOTA and some benchmarks ban harnesses because it becomes too easy.

All agentic editors/frameworks have skills and extensions and plugins?

Re: What Is a Harness?

#35
post #24

i also like the backpack analogy the harness is what you take with you on a trip/task whatever you take with you is not free (system prompt, tools, skills …) some models are really good even if you bring almost no skills, tools or system prompt the harness is the complement to the model the better the model the more minimal the harness can be harnesses like pi [0] and smol [1]are on the more minimal end of things [0]…

Not a bad analogy because the bigger your backpack the slower you walk. With models a big context and tool set degrades performance. So you want the smallest harness/backpack that can do the job.

Re: What Is a Harness?

#36
post #15

Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” Right now, it’s like an AC vs DC between Claude and ChatGPT, but once that settles, the harnesses will be the actual value providers. And Pi is the best harness because of the amazing extension system. You can build extensions that turn Pi into a stock trader, software factory, anything. I tried switching to another harness but…

I've never used Pi but I don't see why you can't use stock codex or claude code for the same purpose, what makes Pi special? I've built plenty of custom harnesses on top of claude code and codex using custom skills or simple markdown instructions and subagents. Never had any issues or limitations with that approach. I do agree that harnesses are going to extend AI capabilities a lot in the next year, but after readin…

Author here. I think our website could be much clearer - but Pi is fundamentally easier to mold than other harnesses. It’s not magic but it strikes the balance well of letting you shape it extensively without letting you break it.

Re: What Is a Harness?

#37
post #20

Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” Right now, it’s like an AC vs DC between Claude and ChatGPT, but once that settles, the harnesses will be the actual value providers. And Pi is the best harness because of the amazing extension system. You can build extensions that turn Pi into a stock trader, software factory, anything. I tried switching to another harness but…

> If LLMs are electricity, harnesses are the “electronics.” (...) the harnesses will be the actual value providers. Don't get ahead of yourself. Harnesses are not exactly rocket science and will be a commodity. The real value providers here are the hardware, then the LLM as a distant second, and at a much larger distance the harness.

I was saying more the custom skills and extensions that make the harness not a commodity. Yes people will use Claude Code, Codex, or Pi but their customizations will make their harness unique and more powerful.

Re: What Is a Harness?

#38
post #5

Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” Right now, it’s like an AC vs DC between Claude and ChatGPT, but once that settles, the harnesses will be the actual value providers. And Pi is the best harness because of the amazing extension system. You can build extensions that turn Pi into a stock trader, software factory, anything. I tried switching to another harness but…

I want to move from Claude Desktop to Pi, but I found it a little unfriendly. Any tips to set it up?

Can you be more specific regarding unfriendliness?

Re: What Is a Harness?

#39

Earlier quoted context omitted.

Sadly, many people have bought into the cult that LLMs will lead to AGI. I guess if that is your worldview then all this babbling about new frontiers makes more sense. They probably used an LLM to come up with this bizarre metaphor.

Did I even mention AGI? All I’m saying is that we’re hitting a plateau with how good models are while harnesses are untapped potential. And with Pi, you can swap models like electricity companies. Yes for now, the electricity is better with some companies but this will stabilize. And no I came up with the metaphor all on my own, send me the chat of you getting the LLM to come up with it. Why not argue based on merit…

I’m afraid it’s a terrible metaphor, starting with the fact that LLMs are nothing like electricity, and the relation of harnesses to them is nothing like that of electronics to electricity, save perhaps one is a prerequisite of the other.

Harnesses (and the concept of agents before them) presuppose competence in LLMs which simply doesn’t exist.

Re: What Is a Harness?

#40

Harnesses are the next frontier. If LLMs are electricity, harnesses are the “electronics.” Right now, it’s like an AC vs DC between Claude and ChatGPT, but once that settles, the harnesses will be the actual value providers. And Pi is the best harness because of the amazing extension system. You can build extensions that turn Pi into a stock trader, software factory, anything. I tried switching to another harness but…

The harness is just another codebase for the model to write and optimize. The value is still very much in the model.
Post reply on HN