GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
1–10 of 23 posts
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#2Nice! It is missing Codex in the agent harnesses comparison IMO.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#3I'd expect google to do well here, since they were historically strong at multimodal and physics.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#4Yet another "benchmark to promote their own harness"
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#5Please forgive my naivety, but are world models (once they are in a consumer-ready form) expected to outperform any currently existing LLM on these sorts of tasks (i.e. of the physical world)?
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#6It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#7A really frustrating partial presentation, given an apparent lack of testing with a spread of efforts for each model.
Given that there's no reason to believe that Fable's xhigh is comparable to GPT-sol's xhigh, or Opus xhigh, for that matter, it would be far more useful to see the effort level where these tasks no longer achieved their goals.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#8Please forgive my naivety, but are world models (once they are in a consumer-ready form) expected to outperform any currently existing LLM on these sorts of tasks (i.e. of the physical world)?
From what I have seen "world models" are more like video models. The idea is: from a video clip, predict the next frame, like LLMs predict the next word/token from a bit of text.
The idea is that these models should be able to internalize the laws of physics and properties of objects just like LLMs do with grammar rules. To make training more efficient, frames from game engines with hardcoded physics are used. The application is mostly robotics, including autonomous vehicles.
This is a bit different, the idea is to write a physics engine, it means numbers: like for an airplane model, calculate the climb rate. The application is mostly science and engineering.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#9A really frustrating partial presentation, given an apparent lack of testing with a spread of efforts for each model. Given that there's no reason to believe that Fable's xhigh is comparable to GPT-sol's xhigh, or Opus xhigh, for that matter, it would be far more useful to see the effort level where these tasks no longer achieved their goals.
These benchmarks are done with incorrectly and missing a lot of baselines. The article seems very vibe coded too.
Re: GPT-5.6 vs. Claude Fable 5 for Physical AI, which performs best?
#10Google with apptronic should have good models soon