Viewing profile — cjsaltlake

Normal people definitely will not benefit from this by default.

SWE-bench was created to replace olympiad coding benchmarks. I think past olympiad coding benchmarks were much worse representative of real-world coding than something like SWE-ben…

But, that's an enormous source of coding productivity, and it's why Anthropic is worth billions... The reason SWE-bench has been so successful and useful for coding is that softwar…

code clash I think would be quite hard to game or contaminate unintentionally; considering that models need to compete against one another

I suggest reading the Mythos report's discussion on SWE-bench and contamination. I think it's fairly convincing that you can account for contamination and still trust SWE-bench num…

If you read the mythos report, in which they discuss and account for contamination substantially, it still suggests that performance on SWE-bench verified is meaningful. Benchmarks…

Labor replacing devices means nobody works in those fields anymore. If AI can do this for every field, nearly no one will need to work in any field. We'll have a giant fully automa…

We absolutely did not.

I'm also on the SWE-bench team. This was simply a classic bug. We had code before that we believed was sufficient to hide / remove future GitHub history and it turns out it was not…

If trends continue, there will be 10 billion Amish in 100 years.

I think one should be consequentialist about all things.

The only people I hate more than woke people are anti-woke people.

Companies are entities with political interests like any other. The only way you can curtail their influence politically is through regulation. It is reasonable for entities to pur…

The community for straight people is too disparate to be meaningful. .bi is interesting though..

India is a single country, with a relatively well established national identity (obviously not perfect!, but enough for people to work and live in the same area), and a relatively …

Additionally, there's north/south discrimination, with greater antipathy from southern Indians against northern Indians.

It's not at all highly correlated, and skin color certainly wouldn't trump real caste affiliation.

~19:50