AXIOM Benchmarks

AXIOM Benchmarks

AXIOM Benchmarks

Clinical benchmarks built from real patient records, scored on frontier models.

Clinical benchmarks built from real patient records, scored on frontier models.

Leaderboard

How frontier models score

How frontier models score

How frontier models score

Patient History Clinician reviewed

AXIOM-Agents

Follow one patient across three or more real radiology reports, tracking how each finding changes over time and between scans, and write up the full history.

Rubric score
Claude Opus 5high
87.0%±3.4%
Claude Opus 5low
84.3%±3.9%
Claude Opus 5medium
83.7%±4.3%
Gemini 3.1 Prodefault
65.2%±5.1%
Gemini 3 Flashdefault
60.7%±5.2%
Diagnosis Clinician reviewed

AXIOM-Differential

Read the findings of a real radiology report and name the radiologist’s diagnosis in your own words, with no options given, scored on both the top answer and the top three.

Top-1 accuracy
GPT-5.6 Solhigh
68.2%±13.3%
Claude Opus 5medium
52.3%±14.2%
Claude Opus 5high
52.3%±14.2%
Gemini 4 Argondefault
47.7%±14.2%
Claude Opus 5low
45.5%±14.1%
Radiology Clinician reviewed

AXIOM-Impression

Read a real radiology report with the impression removed and reach the same clinical conclusion the radiologist wrote.

Accuracy
Gemini 3.8 Flashmedium
70.8%±10.8%
Gemini 3.8 Flashhigh
67.7%±11.1%
Gemini 3.1 Prohigh
61.5%±11.5%
GPT-5.6 Solhigh
60.0%±11.6%
Claude Opus 5high
56.9%±11.7%
Breast Imaging Clinician reviewed

AXIOM-Breast

Read a real breast imaging report with the conclusion removed and assign the BI-RADS category, where every case is a probably-benign BI-RADS 3 that is easy to over- or under-call.

Accuracy
GPT-5.6 Solhigh
84.1%±10.7%
Gemini 3.1 Promedium
72.7%±12.8%
Gemini 3.1 Prodefault
68.2%±13.3%
Gemini 4 Argondefault
65.9%±13.5%
Gemini 3.8 Flashdefault
63.6%±13.7%
Organ Systems Clinician reviewed

AXIOM-Organs

Answer clinical questions about real radiology reports that span many organ systems, testing whether a model draws the right conclusion from the findings.

Accuracy
Gemini 4 Argonhigh
78.3%±7.8%
Gemini 3.8 Flashhigh
60.4%±9.2%
Claude Opus 5high
57.5%±9.2%
GPT-5.6 Solhigh
53.8%±9.3%
Qwen 3.8 27B
20.8%±7.7%
Orthopedics Clinician reviewed

AXIOM-Ortho

Answer clinical questions about real orthopedic radiology reports, drawing the conclusion a reader would from the bone and joint findings.

Accuracy
Gemini 4 Argonhigh
71.2%±12.0%
GPT-5.6 Solhigh
55.8%±13.0%
Gemini 3.8 Flashhigh
51.9%±13.1%
Claude Opus 5high
48.1%±13.1%
Gemma 4 31B
19.2%±10.6%
Diagnosis & Workup Clinician reviewed

AXIOM-Diagnosis

Choose the right diagnosis or next workup step from a real radiology report, using only questions that can’t be answered without reading the report.

Accuracy
Claude Opus 5high
99.3%±0.9%
Gemini 3.6 Flashmedium
88.2%±7.9%
gpt-oss-120bhigh
84.3%±8.8%
Baichuan-M2 32B
64.1%±10.5%
MedGemma 27B
47.1%±10.5%
Diagnosis & Workup Clinician reviewed

AXIOM-Diagnosis-Extended

The same diagnosis and workup task as AXIOM-Diagnosis over nearly twice as many questions, for a tighter comparison between models.

Accuracy
Claude Opus 5high
97.9%±2.4%
Gemini 3.6 Flashmedium
92.3%±4.6%
gpt-oss-120bhigh
84.9%±6.7%
Baichuan-M2 32B
66.0%±7.8%
MedGemma 27B
48.1%±8.3%

Methodology

How AXIOM is built

Real records, clinicians in the loop, intervals on every score.

01

Real clinical records

De-identified reports, not exam questions or synthetic vignettes.

02

Clinicians in the loop

Every question is developed with clinicians and validity-checked.

03

Built to be hard

Questions answerable without the record are removed.

04

Honest statistics

Every score carries a 95% interval. Close scores are ties.

FAQs

How do I get my model evaluated on AXIOM?

Contact us. We run the full suite privately, including pre-release checkpoints.

Can we license the question sets or the data behind them?

Yes. The data behind AXIOM is available to labs under a data agreement.

Why are some models not ranked on a benchmark?

Models that helped select a set’s questions are not ranked on it.

Why publish intervals instead of single scores?

A gap of a few points is often noise.

How often are results updated?

As new frontier models ship. Current results are from November 2026.

Find out where your model breaks.

Find out where your model breaks.

Find out where your model breaks.

Evaluate your model

© 2026 Generative Medical, Inc. Palo Alto, CA.