All terms
Evaluation
MMLU-Pro
A harder, more reasoning-focused version of the MMLU knowledge benchmark.
Definition
MMLU-Pro is a tougher version of MMLU, the broad multiple-choice knowledge test. It adds more reasoning-heavy questions and more answer choices, and it was built to tell strong models apart after the original MMLU became too easy to be discriminating.