All terms
Evaluation
GPQA Diamond
The hardest subset of the GPQA graduate-level science benchmark.
Definition
GPQA Diamond is the hardest subset of GPQA, a science question-answering benchmark written by experts to be tough even with web access. The Diamond questions test advanced reasoning in fields like biology, physics, and chemistry, and are used to separate the strongest models.