arXiv:2509.11714eess.IVcs.LG2025-09

用AI结合病历与影像,自动识别肺结节并判断良恶性

EMeRALDS: Electronic Medical Record Driven Automated Lung Nodule Detection and Classification in Thoracic CT Images

  • 用文本提示替代传统图像提示,提升肺结节定位精度
  • 结节分割Dice达0.92,恶性分类特异性高达0.97
  • 融合放射组学与模拟病历,让AI诊断更贴近临床

肺癌是全球癌症死亡的主要原因,主要源于诊断延迟和早期发现不足。本研究旨在开发一种基于大视觉语言模型(VLM)的计算机辅助诊断(CAD)系统,用于准确检测和分类胸部CT中的肺结节。提出一个端到端的CAD流程,包含两个模块:(i) 基于Segment Anything Model 2(SAM2)的检测模块(CADe),将标准视觉提示替换为由CLIP编码的文本提示;(ii) 诊断模块(CADx),通过计算分割结节与放射组学特征之间的相似度进行分类。为引入临床背景,使用专家放射科医生的放射组学评估生成合成电子病历(EMR),并与相似度得分结合进行最终分类。方法在公开数据集LIDC-IDRI(1,018例CT扫描)上测试。结果表明,该方法在零样本肺结节分析中表现优异:CADe模块结节分割的Dice分数为0.92,交并比(IoU)为0.85;CADx模块恶性分类特异性达0.97,超过现有全监督方法。结论:将VLM与放射组学及合成病历结合,可实现准确且具有临床意义的肺结节CAD。该系统有望提升早期肺癌筛查能力,增强诊断信心,并改善常规临床工作流程中的患者管理。

原文摘要 · Abstract (English)

Objective: Lung cancer is a leading cause of cancer-related mortality worldwide, primarily due to delayed diagnosis and poor early detection. This study aims to develop a computer-aided diagnosis (CAD) system that leverages large vision-language models (VLMs) for the accurate detection and classification of pulmonary nodules in computed tomography (CT) scans. Methods: We propose an end-to-end CAD pipeline consisting of two modules: (i) a detection module (CADe) based on the Segment Anything Model 2 (SAM2), in which the standard visual prompt is replaced with a text prompt encoded by CLIP (Contrastive Language-Image Pretraining), and (ii) a diagnosis module (CADx) that calculates similarity scores between segmented nodules and radiomic features. To add clinical context, synthetic electronic medical records (EMRs) were generated using radiomic assessments by expert radiologists and combined with similarity scores for final classification. The method was tested on the publicly available LIDC-IDRI dataset (1,018 CT scans). Results: The proposed approach demonstrated strong performance in zero-shot lung nodule analysis. The CADe module achieved a Dice score of 0.92 and an IoU of 0.85 for nodule segmentation. The CADx module attained a specificity of 0.97 for malignancy classification, surpassing existing fully supervised methods. Conclusions: The integration of VLMs with radiomics and synthetic EMRs allows for accurate and clinically relevant CAD of pulmonary nodules in CT scans. The proposed system shows strong potential to enhance early lung cancer detection, increase diagnostic confidence, and improve patient management in routine clinical workflows.

肺结节检测视觉语言模型医学影像AI辅助诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。