EXACT让3D肺部CT自动定位病灶并生成可解释的诊断报告。
EXACT: an explainable anomaly-aware vision foundation model for analysis of 3D chest CT
- 通过弱监督学习,从影像与报告对中提取空间分辨的异常图谱。
- 在25,692组数据上预训练,实现无标注的多病种异常定位。
- 适合临床医生用于快速定位病灶,提升AI诊断可信度。
胸部计算机断层扫描(CT)在胸腔疾病检测与管理中至关重要,但体积影像规模与复杂性日益增长,仅靠扫描级预测已无法满足需求。临床可用的AI需不仅能识别全体积病变,还需定位异常并提供可解释的视觉证据。现有视觉-语言基础模型通常将扫描与报告压缩为全局图像-文本表示,限制了空间证据保留与临床意义解读能力。本文提出EXACT,一种可解释的异常感知三维胸部CT基础模型,通过配对的临床影像与放射科报告学习空间分辨表征。EXACT在25,692组CT-报告对上使用解剖感知弱监督进行预训练,联合学习器官分割与多实例异常定位,无需人工体素级标注。生成的器官特异性异常感知图谱为每个体素分配对应解剖结构的疾病特异性异常分数,同时编码病灶范围与器官上下文信息。在回顾性跨国多中心评估中,EXACT在多疾病诊断、零样本异常定位、下游适配及视觉引导报告生成等任务中均表现优异,优于现有三维医学基础模型。通过将常规临床CT与自由文本报告转化为可解释的体素级表征,EXACT建立了一种可信的体积医学AI可扩展范式。
原文摘要 · Abstract (English)
Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically useful AI for CT must not only recognize disease across the whole volume, but also localize abnormalities and provide interpretable visual evidence. Existing vision-language foundation models typically compress scans and reports into global image-text representations, limiting their ability to preserve spatial evidence and support clinically meaningful interpretation. Here we developed EXACT, an explainable anomaly-aware foundation model for three-dimensional chest CT that learns spatially resolved representations from paired clinical scans and radiology reports. EXACT was pre-trained on 25,692 CT-reports pairs using anatomy-aware weak supervision, jointly learning organ segmentation and multi-instance anomaly localization without manual voxel-level annotations. The resulting organ-specific anomaly-aware maps assign each voxel a disease-specific anomaly score confined to its corresponding anatomy, jointly encoding lesion extent and organ-level context. In retrospective multinational and multi-center evaluations, EXACT showed broad and consistent improvements across clinically relevant CT tasks, spanning multi-disease diagnosis, zero-shot anomaly localization, downstream adaptation, and visually grounded report generation, outperforming existing three-dimensional medical foundation models. By transforming routine clinical CT scans and free-text reports into explainable voxel-level representations, EXACT establishes a scalable paradigm for trustworthy volumetric medical AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。