1–9 of 9 posts
Has there been any actual head to head comparison of this using frontier models? Any benchmarks that purport to measure this?
The frontier moves quickly enough that empiric testing is often out of date by the time that it’s published.
The frontier moves quickly enough that empiric testing is often out of date by the time that it’s published.
For sure! It's possible there are relatively invariant properties that make one language or another "better" for LLM coding in general though (even if that's just the self-fulfilling prophecy of size of the training corpus).
I’ve seen a lot of blog posts with fairly dubious claims here with relatively flimsy evidence. And I’ve seen a few papers trying to tackle the topic. But I think it’s a very open area of research currently.
Conclusion: Elixir was the best (had the highest problem solve rate).
Reasons (Theo's interpretation):
- code collocation, where documentation is integrated directly within the source code
- design philosophy of a language (readability, clear idioms, and strict expectation management)
---
Sources from video:
- https://github.com/Tencent-Hunyuan/AutoCodeBenchmark/tree/ma...
- https://martinalderson.com/posts/which-programming-languages...
- https://simonwillison.net/2026/Jan/19/nanolang/#atom-everyth...