ActiveKnowledge
SimpleQA
4,326 short fact-seeking questions chosen to stump GPT-4 — a hallucination test graded correct / incorrect / not-attempted.
Top Benchmarks & Trusted AI Evaluation Directory
Comprehensive directory of 63+ LLM benchmarks with honest status labels, contamination risk assessments, and vendor vs independent score provenance as of September 2026.
Capability Domains
Status
Contamination
Sort By
Displaying 6 of 6 benchmarks (filtered from 63)
ActiveKnowledge
Humanity's Last Exam
~2,500 expert-written questions across 100+ subjects, each filtered to stump frontier models — designed to be the final closed-ended academic benchmark.
Nearing SaturationKnowledge
MMLU-Pro
MMLU rebuilt to fix its flaws: 10 options instead of 4, trivia and label noise filtered out, and reasoning-heavy questions that reward chain-of-thought.
Nearing SaturationKnowledge
GPQA
PhD-written science questions so hard that skilled non-experts with Google score 34% — the 'Google-proof' exam, reported on its 198-question Diamond subset.
SaturatedKnowledge
MMLU
57-subject multiple-choice exam spanning STEM, humanities, and social sciences — the defining knowledge benchmark of the 2020–2024 era.
SaturatedKnowledge
MMLU-Redux
A manual error audit of MMLU: experts re-annotated thousands of questions and found ~6.5% are broken — the evidence base for MMLU's label-noise ceiling.