StepFun 3.5 Flash is #1 cost-effective model for OpenClaw tasks (300 battles)

Post by ygouzerh » Thu, Apr 02, 2026, 2:37 AM UTC

skysniper wrote: post #40

mgw wrote: post #36

Missing from the comparison is MiMo V2 Flash (not Pro), which I think could put up a good fight against Step 3.5 Flash. Pricing is essentially the same: MiMo V2 Flash: $0.09/M input, $0.29/M output Step 3.5 Flash: $0.10/M input, $0.30/M output MiMo has 41 vs 38 for Step on the Artificial Analysis Intelligence Index, but it's 49 vs 52 for Step on their Agentic Index.

I will try and add it. But I doubt it works well because Mimo V2 Pro is beaten by stepfun even at performance leaderboard (price is not a factor in this leaderboard), so I expect MiMo V2 Flash to perform even worse.

Post by arjie » Thu, Apr 02, 2026, 3:53 AM UTC

hadlock wrote: post #5

According to openrouter.ai it looks like StepFun 3.5 Flash is the most popular model at 3.5T tokens, vs GLM 5 Turbo at 2.5T tokens. Claude Sonnet is in 5th place with 1.05T tokens. Which isn't super suprising as StepFun is ~about 5% the price of Sonnet. https://openrouter.ai/apps?url=https%3A%2F%2Fopenclaw.ai%2F

Post by kdasme » Thu, Apr 02, 2026, 4:42 AM UTC

p1necone wrote: post #70

Aerroon wrote: post #68

Earlier quoted context omitted.

If they use OpenRouter pricing then the Qwen3.5 models are going to be poor value. The Qwen3.5 27B model on OR is $1.56/million tokens out (it used to be $2.4/mil). Meanwhile Minimax M2.7 (a much larger model) is $1.2/mil out. The smaller and medium tier Qwen3.5 models are only really cost effective if you run them yourself.

Is Minimax M2.7 better than Qwen3.5 27B, or is it just bigger?

Post by selcuka » Thu, Apr 02, 2026, 5:39 AM UTC

ipython wrote: post #50

I was excited to read through this to find out how these tasks are evaluated at scale. Lots of scary looking formulas with sigmas and other Greek letters. Then I clicked on one task to see what it looks like “on the ground”: https://app.uniclaw.ai/arena/DDquysCGBsHa (not cherry picked- literally the first one I clicked on) The task was: > Find rental properties with 10 bedrooms and 8 or more bathrooms within a 1 hour…

Post by wg0 » Thu, Apr 02, 2026, 5:47 AM UTC

clausewitz wrote: post #76

I'm not seeing Deepseek mentioned very often, which I've been using for Openclaw, very cheaply I might add, with great success. I think I loaded $10 to my account 2 months ago and I still havent needed to top up.