Dingjie Song
Welcome! I am a research assistant affiliated with the CUHK-Shenzhen NLP group, under the guidance of Dr. Benyou Wang. I obtained my M.E. from the Software Institute and the Natural Language Processing Group at Nanjing University, advised by Dr. Xinyu Dai and Dr. Jidong Ge. Prior to this, I completed my B.E. at the Software Institute of Nanjing University.
Email: bbsngg@outlook.com
Links: Research Overview / Updates / Awards / Papers
Research Overview
My research interests are in Natural Language Processing, especially intelligent interactive systems 🤖 and Domain-specific LLMs 👨🏻⚕️ and the following directions:
- Multimodal LLM [MileBench]
- Medical LLM: [CMB], [HuatuoGPT-II]
- Multilingual LLM: [AceGPT]
- Task-oriented dialogue systems: [EPL, NLPCC 2023 Oral], [STAM, JCST 2023]
Updates
July 2024: 🎉🎉 Two papers MileBench and HuatuoGPT2 were accepted to COLM’24 main conference!
April 2024: MileBench 🛣️ released! MileBench is a pioneering benchmark designed to rigorously test the MultImodal Long-contExt capabilities of MLLMs. More information can be found on the 🌐 website, 📃 paper, 🤗 HuggingFace and the GitHub.
March 2024: 🎉🎉 Two papers CMB and AceGPT were accepted to NAACL’24 main conference!
Nov 2023: HuatuoGPT2 released! Try it out on the 🌐 demo! HuatuoGPT2 employs an innovative domain adaptation method to significantly boost its medical knowledge and dialogue proficiency and showcases SOTA performance in several medical benchmarks, especially surpassing GPT-4 in expert evaluations and the fresh medical licensing exams. More info can be found in 📃 paper and 🤗 HuggingFace.
Sep 2023: We publish AceGPT that achieved top performance among open-source Arabic language models in benchmark tests. More info can be found in 📃 paper and 🤗 HuggingFace.
Aug 2023: Checkout our 📃 new paper that focuses on benchmarking prevalent Medical LLMs for their medical knowledge and clinical diagnostic capabilities. More information can be found on the 🌐 website and the 🤗 HuggingFace.
Jul 2023: Start the journey in CUHK-sz as a research assistant under the guidance of Benyou Wang.
Jun 2023: I defended my master’s degree and got my master’s degree in software engineering. Thanks to all those who have supported me.
Aug 2022 - Apr 2023: Finished my internship with Jiaxing Zhang on LLM SFT.
Papers
2024
- MileBench: Benchmarking MLLMs in Long Context Dingjie Song, Shunian Chen, Guiming Hardy Chen, Fei Yu, Xiang Wan, Benyou Wang COLM 2024, project page, code and data
2023
HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs Junying Chen, Xidong Wang, Anningzhe Gao, Feng Jiang, Shunian Chen, Hongbo Zhang, Dingjie Song, Wenya Xie, Chuyi Kong, Jianquan Li, Xiang Wan, Haizhou Li, Benyou Wang COLM 2024, project page, code and data
AceGPT, Localizing Large Language Models in Arabic Huang Huang*, Fei Yu*, Jianqing Zhu*, Xuening Sun, Hao Cheng, Dingjie Song, Zhihong Chen, Abdulmohsen Alharthi, Bang An, Juncai He, Ziche Liu, Zhiyi Zhang, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, Jinchao Xu NAACL 2024, code and data
CMB: A Comprehensive Medical Benchmark in Chinese Dingjie Song*, Xidong Wang*, Guiming Hardy Chen* (equal contribution), Zhiyi Zhang*, Zhihong Chen, Qingying Xiao, Feng Jiang, Jianquan Li, Xiang Wan, Benyou Wang, Haizhou Li *NAACL 2024, project page, code and data
Episode-based Prompt Learning for Any-shot Intent Detection Dingjie Song*, Pengfei Sun* (*equal contribution), Yawen Ouyang, Zhen Wu, Xinyu Dai NLPCC 2023 Oral
2022
- Self-Supervised Task Augmentation for Few-Shot Intent Detection Pengfei Sun, Yawen Ouyang, Dingjie Song, Xinyu Dai JCST 2022 code and data
Awards
- Outstanding Graduate Student, Nanjing University, 2022
- Yingcai Scholarship, Nanjing University, 2022
- Renmin Scholarship (People’s Scholarship), Nanjing University, 2018-2021
- Third Runner’s Up in 15th Citi Cup Financial Innovation Application Competition, Citigroup, 2019
- Second Runner’s Up in 2019 “Chain to Future” University Blockchain Technology Application Competition, CCF, 2019
- Outstanding Student Leader of the Communist Youth League, Nanjing University, 2018-2019
Services
- Conference reviewer: EMNLP, ACL Rolling Review
