Viewing profile — marsh_mellow

p-value of 7.9% — so very close to statistical significance. the p-value for GPT-4.1 having a win rate of at least 49% is 4.92%, so we can say conclusively that GPT-4.1 is at least…

I don't think the absolute score means much — judge models have a tendency to score around 7/10 lol 55% vs. 45% equates to about a 36 point difference in ELO. in chess that would b…

Good point. They said they validated the results by testing with other models (including Claude), as well as with manual sanity checks. 55% to 45% definitely isn't a blowout but it…

From OpenAI's announcement: > Qodo tested GPT‑4.1 head-to-head against Claude Sonnet 3.7 on generating high-quality code reviews from GitHub pull requests. Across 200 real-world pu…

Very cool! Could this work for detecting nearby drones?

Anthropic blog post outlining the research process: https://www.anthropic.com/news/developing-computer-use Computer use API documentation: https://docs.anthropic.com/en/docs/build-…

To tag on to this, what are the most useful capabilities besides code generation?

This is great. Is there any work being done to make something similar part of the browser API?

There's an open source version of this as well: https://github.com/Codium-ai/pr-agent

They list seven different use cases in this technical blog: https://harrison.ai/news/reimagining-medical-ai-with-the-mos... I'd interpret it as a foundation model in the radiology …