Forgive my stupidity but how do you run Claude Code with non-Anthropic models?
Claude Code allows you to change the config such that you use the harness with different models - you can actually ask a coding agent to configure it for you
Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
11–20 of 67 posts
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#12Forgive my stupidity but how do you run Claude Code with non-Anthropic models?
Claude Code supports the base URL env var so you could tell it to talk with any LLM API endpoint that receives the Anthropic style request format, e.g. DeepSeek.
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#13Forgive my stupidity but how do you run Claude Code with non-Anthropic models?
[deleted]
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#14I've been confused a lot why there isn't a benchmark to measure a harness's performance rather than the model's one. Now there it is.
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#15Harness wars are the next browsers wars!!
But wow, opencode is that bad?!
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#16With all the hype around the latest Gemini 3.8 Flash/Cyber release, will Antigravity CLI [1] be supported?
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#17Good start, but needs to be harness x model to be useful. 3 top harnesses x 3 top models would be more interesting.
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#18Do you have instructions on how to run a custom harness against this? There are none on the linked page. I want to run Dirac ( https://github.com/dirac-run/dirac ).
+1, I'll also add Maki to the list:
https://github.com/tontinton/maki
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#19Putting only the tasks and results in the repo is a poor decision. These conclusions would be far more credible if anyone could re-run the benchmark.
Re: Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
#20[flagged]