构建了1365例真实世界肺癌多模态数据集,支持临床预测研究。
Real-World Multi-Modal and Longitudinal Lung Cancer Dataset

- 整合影像、临床、基因等多源数据,覆盖三类影像与纵向随访信息
- 包含超1300例患者,各模态存在不均衡缺失,适合测试鲁棒融合方法
- 提供生存预测基准,验证多模态融合在真实医疗场景中的有效性
多模态学习通过融合医学影像、临床记录和基因组数据,在医疗应用中展现出强大潜力,但其发展常受限于高质量、真实世界数据的匮乏以及异构数据融合的难度。本文构建了一个多中心、多模态、纵向的肺癌数据集,涵盖1365名患者,包含全切片图像、CT、PET三种影像模态,结构化临床数据、转录组数据及长期随访与治疗信息。每类影像均有多个实例,且各模态存在显著且非均匀的缺失情况,适用于评估各类学习模型在真实临床条件下的表现。我们提供了12个月总生存率预测、疾病特异性生存及严重缺失数据下的风险预测纵向基准。结果表明,尽管存在高缺失率,融合互补模态仍持续优于单模态方法,凸显多模态融合在真实临床环境中的价值。数据集与基准代码已开源。
原文摘要 · Abstract (English)
Multi-modal learning has demonstrated strong potential in medical applications by integrating heterogeneous data sources such as medical imaging, clinical records, and genomics to improve predictive performance and support clinical decision-making. However, advances in this area are often constrained by two key challenges: the limited availability of well-curated, ready-to-use datasets that accurately reflect real-world conditions, where medical data are frequently collected inconsistently and are often incomplete; and the inherent difficulty of integrating heterogeneous data modalities. In this work, we introduce a newly curated multi-center, multi-modal, and longitudinal dataset designed to support the evaluation of a wide range of learning pipelines under realistic conditions. The dataset comprises a total of 1,365 lung cancer patients and has three imaging modalities (whole-slide images, CT scans, and PET scans), structured clinical data, transcriptomic, and longitudinal follow-up and treatment information. For each imaging modality the dataset contains more than one instance. Moreover, the dataset exhibits substantial and non-uniform missingness across modalities, making it well-suited for studying robust multi-modal fusion strategies. We further provide both uni-modal and multi-modal benchmarks on the task of 12-month overall survival prediction, disease-specific survival, as well as longitudinal benchmark of hazard prediction under severe missing data. Our results show that, despite high levels of missingness, integrating complementary modalities consistently improves predictive performance over uni-modal approaches, highlighting the value of multi-modal fusion in realistic clinical settings. The dataset and benchmark code are available at https://github.com/ritacmendes/MMIST-LUNG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。