arXiv:2501.16400eess.IVphysics.med-ph2025-01中稿 · the 2025 IEEE Inte…被引 3

用随访CT和临床数据预测肺结节恶性程度,准确率达89.7%

CSF-Net: Cross-Modal Spatiotemporal Fusion Network for Pulmonary Nodule Malignancy Predicting

  • 融合随访CT与临床信息的时空特征,模拟医生决策
  • 在NLST-cmst数据集上达89.7%准确率、93.3%召回率
  • 适合临床辅助诊断场景,尤其关注动态变化的结节

肺结节是肺癌的早期表现,早期检测对提高患者生存率至关重要。当前多数方法仅依赖单次计算机断层扫描(CT)图像评估结节恶性程度,而临床实践中医生通常结合随访CT与临床信息进行综合判断。为此,本文提出一种跨模态时空融合网络CSF-Net,利用随访CT扫描预测肺结节恶性程度,模拟临床医生的决策过程。CSF-Net包含三个核心模块:空间特征提取模块、时间残差融合模块和跨模态注意力融合模块,协同实现精准恶性度预测。此外,我们基于公开的NLST数据集,标注肺结节具体位置,构建了新数据集NLST-cmst。在NLST-cmst上的实验表明,该方法显著提升性能:准确率0.8974,精确率0.8235,F1分数0.8750,AUC 0.9389,召回率0.9333。结果证明,结合随访数据与临床信息的多模态时空融合方法优于现有技术,具有显著有效性。

原文摘要 · Abstract (English)

Pulmonary nodules are an early sign of lung cancer, and detecting them early is vital for improving patient survival rates. Most current methods use only single Computed Tomography (CT) images to assess nodule malignancy. However, doctors typically make a comprehensive assessment in clinical practice by integrating follow-up CT scans with clinical data. To enhance this process, our study introduces a Cross-Modal Spatiotemporal Fusion Network, named CSF-Net, designed to predict the malignancy of pulmonary nodules using follow-up CT scans. This approach simulates the decision-making process of clinicians who combine follow-up imaging with clinical information. CSF-Net comprises three key components: spatial feature extraction module, temporal residual fusion module, and cross-modal attention fusion module. Together, these modules enable precise predictions of nodule malignancy. Additionally, we utilized the publicly available NLST dataset to screen and annotate the specific locations of pulmonary nodules and created a new dataset named NLST-cmst. Our experimental results on the NLST-cmst dataset demonstrate significant performance improvements, with an accuracy of 0.8974, a precision of 0.8235, an F1 score of 0.8750, an AUC of 0.9389, and a recall of 0.9333. These findings indicate that our multimodal spatiotemporal fusion approach, which combines follow-up data with clinical information, surpasses existing methods, underscoring its effectiveness in predicting nodule malignancy.

肺结节多模态融合随访分析医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。