Arena AI Model ELO History

Post by selcuka » Thu, May 14, 2026, 6:07 AM UTC

jychang wrote: post #9

selcuka wrote: post #7

Earlier quoted context omitted.

> we don't switch to heavily quantized models That sounded like a press bulletin, so just to let you clarify yourself: Does that mean you may switch to lightly quantized models?

There's almost 0% chance that OpenAI doesn't quantize the model right off the bat. I am willing to bet large amounts of money that OpenAI would never release a model served as fully BF16 in the year of our lord 2026. That would be insane operationally. They're almost certainly doing QAT to FP4 for FFN, and a similar or slightly larger quant for attention tensors.

Post by cherioo » Thu, May 14, 2026, 6:50 AM UTC

Post by andrewshadura » Thu, May 14, 2026, 7:10 AM UTC

tedsanders wrote: post #4

FYI, Elo isn't an acronym - it's a person's name. No need to capitalize it as ELO.

Post by andrewshadura » Thu, May 14, 2026, 7:12 AM UTC

gitowiec wrote: post #12

SilverElfin wrote: post #5

Earlier quoted context omitted.

You’re right: https://en.wikipedia.org/wiki/Elo_rating_system

> ELO ratings Thank you, I just looked at the chart and said to myself: ELO? YOLO! That Elo ranking is also called chess ranking

Post by energy123 » Thu, May 14, 2026, 7:19 AM UTC

XCSme wrote: post #16

cherioo wrote: post #13

The interesting thing I find is how Anthropic has been more consistently improving over time in the last few years, that allows it to catchup and surpass OpenAI and Google. The latter two have pretty much plateau over the last year or so. GPT 5.5 is somehow not moving the needle at all. I hope to see the other labs can bring back competition soon!

Gpt 5.5 is quite a big leap, it's a lot better than opus 4.7 for agentic coding