Live data from Hacker News

Sonnet 5 is 2.5x cheaper than Opus 4.8 and 6 points behind on SWE-bench Pro

spark.temrel.com

1–2 of 2 posts

Re: Sonnet 5 is 2.5x cheaper than Opus 4.8 and 6 points behind on SWE-bench Pro

#2
I wrote this after realising I'd never once reconsidered my default model. The scoring system is deliberately crude (four axes, 1-3 each). Curious whether people who route per task find the overhead worth it, or whether one default model is still the right call for most.