Publications

Google Scholar

(* denotes equal contribution)

Preprints

• Dr. Claw: An AI Research Workspace from Idea to Paper
  Dingjie Song, Hanrong Zhang, Dawei Liu, Yixin Liu, Zongxia Li, Zhengqing Yuan, Siqi Zhang, Lichao Sun
  Software, 2026, project page, code, news
  

• OpenSkill: Open-World Self-Evolution for LLM Agents
  Zhiling Yan*, Dingjie Song*, Hanrong Zhang, Wei Liang, Yuxuan Zhang, Yutong Dai, Lifang He, Philip S. Yu, Ran Xu, Xiang Li, Lichao Sun
  arXiv, Under Review, project page, code
  

• AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery
  Guiyao Tie, Jiawen Shi, Dingjie Song, Yixiao Huang, Ziji Sheng, Xueyang Zhou, Daizong Liu, Pan Zhou, Yongchao Chen, Ran Xu, Lifang He, Qingsong Wen, Manling Li, Cong Lu, Shuai Li, Pengtao Xie, Yixuan Yuan, Rui Meng, Lei Xing, Lichao Sun, Caiming Xiong, Philip S. Yu, Jianfeng Gao
  arXiv, Under Review
  

• Towards a Medical AI Scientist
  Hongtao Wu*, Boyun Zheng*, Dingjie Song*, Yu Jiang, Jianfeng Gao, Lei Xing, Lichao Sun, Yixuan Yuan
  arXiv, Under Review
  

• CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generation
  Mingzhe Zheng, Dingjie Song, Guanyu Zhou, Jun You, Jiahao Zhan, Xuran Ma, Xinyuan Song, Ser-Nam Lim, Qifeng Chen, Harry Yang
  arXiv, Under Review, project page
  

• Enhancing Vector Quantization with Distributional Matching: A Theoretical and Empirical Study
  Xianghong Fang, Litao Guo, Hengchao Chen, Yuxuan Zhang, Xiaofan Xia, Dingjie Song, Yexin Liu, Hao Wang, Harry Yang, Yuan Yuan, Qiang Sun
  arXiv, Under Review
  

• Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents
  Zhejian Yang, Yongchao Chen, Xueyang Zhou, Jiangyue Yan, Dingjie Song, Yinuo Liu, Yuting Li, Yu Zhang, Pan Zhou, Hechang Chen, Lichao Sun
  arXiv, Under Review, project page
  

• Aligning Multimodal LLM with Human Preference: A Survey
  Tao Yu, Yi-Fan Zhang, Chaoyou Fu, Junkang Wu, Jinda Lu, Kun Wang, Xingyu Lu, Yunhang Shen, Guibin Zhang, Dingjie Song, Yibo Yan, Tianlong Xu, Qingsong Wen, Zhang Zhang, Yan Huang, Liang Wang, Tieniu Tan
  arXiv, Under Review, project page
  

• A Survey on Post-training of Large Language Models
  Guiyao Tie, Zeli Zhao, Dingjie Song, Fuyang Wei, Rong Zhou, Yurou Dai, Wen Yin, Zhejian Yang, Jiangyue Yan, Yao Su, Zhenhan Dai, Yifeng Xie, Yihan Cao, Lichao Sun, Pan Zhou, Lifang He, Hechang Chen, Yu Zhang, Qingsong Wen, Tianming Liu, Neil Zhenqiang Gong, Jiliang Tang, Caiming Xiong, Heng Ji, Philip S. Yu, Jianfeng Gao
  arXiv, Under Review
  

• From Correctness to Comprehension: AI Agents for Personalized Error Diagnosis in Education
  Yi-Fan Zhang, Hang Li, Dingjie Song, Lichao Sun, Tianlong Xu, Qingsong Wen
  arXiv, Under Review
  

• BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement
  Yuhao Du, Shunian Chen, Wenbo Zan, Peizhao Li, Mingxuan Wang, Dingjie Song, Bo Li, Yan Hu, Benyou Wang
  arXiv, Under Review, project page
  

2026

• Can MLLMs Read Students’ Minds? Unpacking Multimodal Error Analysis in Handwritten Math
  Dingjie Song, Tianlong Xu, Yi-Fan Zhang, Hang Li, Zhiling Yan, Xing Fan, Haoyang Li, Lichao Sun, Qingsong Wen
  AIED 2026 Oral, project page, paper, code, data
  

• LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluation
  Zhiling Yan, Dingjie Song, Zhe Fang, Yisheng Ji, Xiang Li, Quanzheng Li, Lichao Sun
  KDD 2026, Datasets and Benchmarks Track
  

2025

• LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  Xidong Wang*, Dingjie Song*, Shunian Chen, Chen Zhang, Benyou Wang
  EMNLP Findings 2025, project page, code and data
  

• Both Text and Images Leaked! A Systematic Analysis of Multimodal LLM Data Contamination
  Dingjie Song*, Sicheng Lai*, Mingxuan Wang, Shunian Chen, Lichao Sun, Benyou Wang
  EMNLP Findings 2025, ICML 2025 DIG-BUG Workshop Oral, project page
  

• SAMed-2: Selective Memory Enhanced Medical Segment Anything Model
  Zhiling Yan, Sifan Song, Dingjie Song, Yiwei Li, Rong Zhou, Weixiang Sun, Zhennong Chen, Sekeun Kim, Hui Ren, Tianming Liu, Quanzheng Li, Xiang Li, Lifang He, Lichao Sun
  MICCAI 2025, code and data
  

• On the Compositional Generalization of Multimodal LLMs for Medical Imaging
  Zhenyang Cai, Junying Chen, Rongsheng Wang, Weihong Wang, Yonglin Deng, Dingjie Song, Yize Chen, Zixu Zhang, Benyou Wang
  ACL 2025, project page
  

• MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  Wentao Ge*, Shunian Chen*, Guiming Hardy Chen*, Junying Chen, Zhihong Chen, Nuo Chen, Wenya Xie, Shuo Yan, Chenghao Zhu, Ziyue Lin, Dingjie Song, Xidong Wang, Anningzhe Gao, Zhang Zhiyi, Jianquan Li, Xiang Wan, Benyou Wang
  NAACL 2025, project page
  

• Less is More: A Simple yet Effective Token Reduction Method for Efficient Multi-modal LLMs
  Dingjie Song, Wenjun Wang, Shunian Chen, Xidong Wang, Michael Guan, Benyou Wang
  COLING 2025, code and model
  

2024

• MileBench: Benchmarking MLLMs in Long Context
  Dingjie Song, Shunian Chen, Guiming Hardy Chen, Fei Yu, Xiang Wan, Benyou Wang
  COLM 2024, project page, code and data
  

• HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs
  Junying Chen, Xidong Wang, Anningzhe Gao, Feng Jiang, Shunian Chen, Hongbo Zhang, Dingjie Song, Wenya Xie, Chuyi Kong, Jianquan Li, Xiang Wan, Haizhou Li, Benyou Wang
  COLM 2024, project page, code and data
  

• AceGPT, Localizing Large Language Models in Arabic
  Huang Huang*, Fei Yu*, Jianqing Zhu*, Xuening Sun, Hao Cheng, Dingjie Song, Zhihong Chen, Abdulmohsen Alharthi, Bang An, Juncai He, Ziche Liu, Zhiyi Zhang, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, Jinchao Xu
  NAACL 2024, code and data
  

• CMB: A Comprehensive Medical Benchmark in Chinese
  Xidong Wang*, Guiming Hardy Chen*, Dingjie Song*, Zhiyi Zhang*, Zhihong Chen, Qingying Xiao, Feng Jiang, Jianquan Li, Xiang Wan, Benyou Wang, Haizhou Li
  NAACL 2024, project page, code and data
  

2023

• Episode-based Prompt Learning for Any-shot Intent Detection
  Pengfei Sun*, Dingjie Song*, Yawen Ouyang, Zhen Wu, Xinyu Dai
  NLPCC 2023 Oral
  

2022

• Self-Supervised Task Augmentation for Few-Shot Intent Detection
  Pengfei Sun, Yawen Ouyang, Dingjie Song, Xinyu Dai
  JCST 2022, code and data