Benchmarks Are Dead (For Us)
poetiq.ai
Benchmarks Are Dead (For Us)
1–2 of 2 posts
Re: Benchmarks Are Dead (For Us)
#2Poetiq's RSI loop now automatically builds its own benchmark harnesses with zero human intervention — and has hit SOTA on six diverse benchmarks including doubling the previous best on a long-horizon planning task, and a 2M-token retrieval benchmark using a model that doesn't even appear on the base leaderboard.