Live data from Hacker News

The most widely used benchmarks for evaluating LLMs

news.ycombinator.com

1–2 of 2 posts

The most widely used benchmarks for evaluating LLMs

#1
Commonsense Reasoning - HellaSwag - Winogrande - PIQA - SIQA - OpenBookQA - ARC - CommonsenseQA

Logical Reasoning - MMLU - BBHard

Mathematical Reasoning - GSM-8K - MATH - MGSM - DROP

Code Generation - HumanEval - MBPP

World Knowledge & QA - NaturalQuestions - TriviaQA - MMMU - TruthfulQA

I collected their descriptions and links to their original papers here: https://www.turingpost.com/p/llm-benchmarks