LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluation
KDD 2026, Datasets and Benchmarks Track
Zhiling Yan, Dingjie Song, Zhe Fang, Yisheng Ji, Xiang Li, Quanzheng Li, Lichao Sun
TL;DR LiveMedBench combines newly collected clinical cases with automated, case-specific evaluation rubrics to reduce contamination risks, revealing that LLMs struggle to adapt medical knowledge to individual patient contexts.