Live data from Hacker News

Developing a Computer Use Model

anthropic.com

1–2 of 2 posts

Re: Developing a Computer Use Model

#2
> On one evaluation created to test developers’ attempts to have models use computers, OSWorld, Claude currently gets 14.9%. That’s nowhere near human-level skill (which is generally 70-75%), but it’s far higher than the 7.7% obtained by the next-best AI model in the same category.

Here, "next-best AI model in the same category" referes to which model.