On the Compositional Generalization of Multimodal LLMs for Medical Imaging

Zhenyang Cai, Junying Chen, Rongsheng Wang, Weihong Wang, Yonglin Deng, Dingjie Song, Yize Chen, Zixu Zhang, Benyou Wang

TL;DR Med-MAT organizes medical imaging datasets by modality, anatomy, and task, showing that multimodal LLMs can generalize to unseen combinations and that this ability helps explain the benefits of multi-task training.