_dont create benchmarks that will incentivize ai labs to optimize towards... Especially ones like battle royal!_
A robot is sprinting towards you. Do you want it running on Claude or Grok?
61–70 of 234 posts
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#62sprinting towards me to help me, or sprinting towards me to hurt me?
i feel like i'm missing a whole lot of context to this article. is it part of a series, or just written with an assumption that i'm going to know what they're talking about
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#63L icon Grok 4.1 Fast won 13 of 30 games at $0.97 per win The next-best winner was A icon Claude Sonnet 4.6 with 5 wins, at $26.78 per win. That’s a 27x difference. The model that isn’t on most top-model lists beat the model that is, on the thing a routing customer actually cares about. The model with the most kills did not win H icon GPT 5.4 killed 38 agents across 30 games. More than anyone else. It came in second o…
That's just how battle royale works.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#64DeepSeek V4 Flash being the winner in cost efficiency causes me exactly zero surprise.
It's a monster at coding. And a fast monster at that.
I use it daily and have been testing if MiMo 2.5 (non pro) is comparable. The nice thing about MiMo is that it has vision capability.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#65The question is: "Do you want to be holding a Mossberg or a Beretta?"
Has anyone done the YouTube research on what is the best way to bring down something like one of the Boston Dynamics robot dogs? 9x19? 00 buck? 5.56x45? 7.62x51? I suppose those bots would be pretty expensive, but maybe there is a cheaper Chinese knock-off? Seems like that sort of test would bring in plenty of clicks.
Maybe Michael Reeves still has one. Or at least knows how they react to different calibers.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#66I wish the author would open source the full benchmark. I'm curious how sensitive the results would be to small changes in the benchmark initial conditions
Open source it and it gets crawled and optimized against and stops being a benchmark of any use whatsoever.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#67The text seems deliberately stripped of llmisms that flag detection. However, not a single line shakes the smell off
As far as I can see, there is still one tell that was missed/left in:
>Grok showed discipline, despite its goblin-like nature.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#68> I didn’t add any frontier-tier models like Opus 4.7, GPT-5.5, or Gemini Ultra. At their prices, 30 games would have cost around $3,000 instead of $482.
I have a lot of thoughts unrelated to the game experiment but more about how these opus/ultra size models can possibly be a financially viable product at scale when it costs $3000 to play 30 simple games. It just seems much much higher than what it would cost to get a human to play 30 rounds
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#69I don’t want anything running on Grok.
Re: A robot is sprinting towards you. Do you want it running on Claude or Grok?
#70Super entertaining article — petition to change the clickbait title