We are a group working at medical artificial intelligence, exploring the new technologies and applications of artificial intelligence in healthcare. The following themes outline our current research interest:
Medical image analsys
Medical natural language processing
Bioinformatics
In the end, we are trying to integrating all modalities (including medical images, patient demographics, clinical notes, and genes) to develop a large multi-modal model and explore its new applications in healthcare.
-
2024Founded
-
1Postdoctoral Researcher
-
12Visiting Students
-
4Assistants
Yefeng Zheng, PH.D.
School of Engineering
Medical Artificial Intelligence Laboratory
Yefeng Zheng was born in the city of Jiangshan, Zhejiang Province, in 1975. He received B.E. and M.E. degrees from the Department of Electronic Engineering, Tsinghua University, Beijing, China in 1998 and 2001, respectively, and a Ph.D. degree from the Department of Electrical and Computer Engineering, University of Maryland, College Park, USA in 2005. From 2006 to 2017, he worked at Siemens Corporate Research in Princeton, New Jersey, USA on medical image analysis. From 2018 to 2024, he was a Distinguished Scientist and Director of Tencent Jarvis Lab, leading the company's initiative on medical artificial intelligence. He joined Westlake University in July 2024 as a tenured full professor. He has invented 90+ US patents and published 300+ papers, which have been cited more than 24,000 times with an h-index of 77. He is a fellow of Institute of Electrical and Electronics Engineers (IEEE), a fellow of American Institute for Medical and Biological Engineering (AIMBE), and an Associate Editor of IEEE Transactions on Medical Imaging. He was a Program Co-Chair of International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) 2021, served as an area chair for various top conferences in artificial intelligence (e.g., NeurIPS, AAAI, IJCAI, and MICCAI).
npj Digital Medicine 2024
A Multimodal Multidomain Multilingual Medical Foundation Model for Zero Shot Clinical Diagnosis (In Press)
F. Liu, Z. Li, Q. Yin, J. Huang, X. Wu, A. Thakur, K. Branson, P. Schwab, B. Yin, Y. Zheng, J. Luo, and D. Clifton
IEEE Transactions on Medical Imaging 2024
Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation (In Press)
J. Sun, D. Wei, Z. Xu, D. Lu, H. Liu, H. Wang, L. Wang, and Y. Zheng
International Journal of Computer Vision 2024
Learning to Generalize Heterogeneous Representation for Cross-Modality Image Synthesis via Multiple Domain Interventions (In Press)
Y. Huang, H. Huang, H. Zheng, Y. Li, F. Zheng, X. Zhen, and Y. Zheng
NeurIPS 2024, poster
MedJourney: Benchmark and Evaluation of Large Language Models over Patient Clinical Journey
Xian Wu, Yutian Zhao, Yunyan Zhang, Jiageng Wu, Zhihong Zhu, Yingying Zhang, Yi Ouyang, Ziheng Zhang, Huimin Wang, Zhenxi Lin, Jie Yang, Shuang Zhao, Yefeng Zheng
NeurIPS 2024, poster
Learning Frequency-Adapted Vision Foundation Model for Domain Generalized Semantic Segmentation
Qi Bi, Jingjun Yi, Hao Zheng, Haolan Zhan, Yawen Huang, Wei Ji, Yuexiang Li, Yefeng Zheng
NeurIPS 2024, Poster
Samba: Severity-aware Recurrent Modeling for Cross-domain Medical Image Grading
Qi Bi, Jingjun Yi, Hao Zheng, Wei Ji, Haolan Zhan, Yawen Huang, Yuexiang Li, Yefeng Zheng
NeurIPS 2024, Spotlight
LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation
Qidong Liu, Xian Wu, Yejing Wang, Zijian Zhang, Feng Tian, Yefeng Zheng, Xiangyu Zhao
EMNLP 2024, Findings
Can LLMs Replace Clinical Doctors? Exploring Bias in Disease Diagnosis by Large Language Models
Yutian Zhao, Huimin Wang, Yuqi Liu, Wu Suhuang, Xian Wu, Yefeng Zheng
EMNLP 2024, Findings
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding
Derong Xu, Ziheng Zhang, Zhihong Zhu, Zhenxi Lin, Qidong Liu, Xian Wu, Tong Xu, Xiangyu Zhao, Yefeng Zheng, Enhong Chen
EMNLP 2024, main
DGLF: A Dual Graph-based Learning Framework for Multi-modal Sarcasm Detection
Zhihong Zhu, Kefan Shen, Zhaorun Chen, Yunyan Zhang, Yuyan Chen, Xiaoqi Jiao, Zhongwei Wan, Shaorong Xie, Wei Liu, Xian Wu, Yefeng Zheng
One paper got accepted by AAAI 2025. Congrats to all co-authors.
One paper got accepted by International Journal of Computer Vision! One paper got accepted by IEEE Transactions on Medical Imaging! Congrats to all co-authors.
One paper got accepted by npj Digital Medicine! Congrats to all co-authors.
Congratulations to Shikun Li on concluding the visit and starting a new role at The Chinese University of Hong Kong.
Three papers got accepted by EMNLP 2024! Congrats to all co-authors.
Dr. Meihong Pan from Shanghai Jiao Tong University joins Medical Artificial Intelligence Laboratory as a postdoctoral researcher. Welcome!
Three papers got accepted by ACM Multimedia 2024! Congrats to all co-authors.
One paper got accepted by CIKM 2024! Congrats to all co-authors.
Four papers got accepted by NeurIPS 2024! Congrats to Qi Bi and all co-authors.
Medical Artificial Intelligence Laboratory has been officially established!
The Medical Artificial Intelligence Laboratory at Westlake University currently has multiple openings for PhD students, postdocs, and research assistants, and welcome motivated applicants to join our research adventures. Candidates with a background in computer vision, natural language processing, machine learning, or other related fields are encouraged to apply.