Simple Meta-Harness on Islo.dev
zozo123.github.io
Simple Meta-Harness on Islo.dev
1–10 of 24 posts
Re: Simple Meta-Harness on Islo.dev
#2I have no idea what this does or is. I really wish they could have given a better description of why this is useful.
Re: Simple Meta-Harness on Islo.dev
#3serious question: I've already got a opencode harness running on a local model. It's easily installable via the insecure bash command. It's already tailored with a couple of plugins and with a proper TODO.md and planning, I can get it to loop fine with proper attention to its pratfalls on vague/non-determinant language. It's all running on a AMD 395+ Qwen3-Coder-Next model with ~256k context. opencode has a webui I can put behind a password protected endpoint and keep it busy from anywhere I need to via a simple nginx proxy.
How does this go above and beyond this straightforward opensource, open weights and relatively cheap setup? Do you just get more tokens from SOTA models? Can anyone rationally say the products of token production are quality and secure?
Re: Simple Meta-Harness on Islo.dev
#4This seems to be another over optimization for AI that many are trying to get into. The LLM's improve, and your setup is deprecated, you wasted time optimizing for a slight edge. TDLR: You trade time for slight edge.
Re: Simple Meta-Harness on Islo.dev
#5I have no idea what this does or is. I really wish they could have given a better description of why this is useful.
[dead]
Re: Simple Meta-Harness on Islo.dev
#6I have no idea what this does or is. I really wish they could have given a better description of why this is useful.
I find it fascinating, all these attempts are goldmining LLMs with a harness and it's clear they're generating all the docs for AI to read and use, even the docs say "we made a MCP for this!" like some how within 2 years people no longer make choices and it's just like AIs roaming the internet trying on harnesses, etc; certainly that'd be a fascinating reality but the verbosity really is a eye-glazing experience. Who do they expect to read all of that ad copy? It's not me.
Re: Simple Meta-Harness on Islo.dev
#7I have no idea what this does or is. I really wish they could have given a better description of why this is useful.
Their lines "A meta-harness is the loop that improves the harness automatically" and "the bottleneck is diagnostic context: most optimizers compress prior runs into summary statistics, while meta-harness gives the proposer up to 10M tokens of raw execution traces to grep through," seem good, no?
Have to dig into the code, but it looks like they have sound engineering around a "self-improving" agentic coding harness. Will be fun to take the code for a spin.
Re: Simple Meta-Harness on Islo.dev
#8serious question: I've already got a opencode harness running on a local model. It's easily installable via the insecure bash command. It's already tailored with a couple of plugins and with a proper TODO.md and planning, I can get it to loop fine with proper attention to its pratfalls on vague/non-determinant language. It's all running on a AMD 395+ Qwen3-Coder-Next model with ~256k context. opencode has a webui I c…
You know how OpenCode can be prompted to modify itself when you want to improve it in some way? This just automates that kind of thing.
Re: Simple Meta-Harness on Islo.dev
#9I have no idea what this does or is. I really wish they could have given a better description of why this is useful.
Their lines "A meta-harness is the loop that improves the harness automatically" and "the bottleneck is diagnostic context: most optimizers compress prior runs into summary statistics, while meta-harness gives the proposer up to 10M tokens of raw execution traces to grep through," seem good, no? Have to dig into the code, but it looks like they have sound engineering around a "self-improving" agentic coding harness.…
10M tokens of raw execution traces to grep through is slop. The tasks are fizzbuzz, palindrome, list reversal, and sum-even. The palindrome challenge is literaly this:
> Is the word "racecar" a palindrome? Answer with exactly one lowercase word: "yes" or "no". Print only the answer.
Re: Simple Meta-Harness on Islo.dev
#10It has now become fashionable to dress oneself in the garb of science to sell dev environments ... for agents.
It has now become fashionable to claim much, and furnish little.
It has now become fashionable to fail to understand or state the core of your proposal in as few words as possible: instead of "genetic algorithm applied to the space of harnesses, parallelized by our infrastructure" we get "Three swaps. Same orchestrator. Same dashboard. The wiring is the thing."
We're cooked chat.