arXiv:2510.21464cs.CV2025-10被引 2

让胸部X光诊断模型说清判断依据,提升临床可信度。

CXR-LanIC: Language-Grounded Interpretable Classifier for Chest X-Ray Diagnosis

  • 从诊断模型中提取5000个可解释的视觉模式,每张图归因20-50个
  • 在5类关键病变上保持竞争力诊断准确率,且激活模式可验证
  • 适合需可信AI的医生、医学算法开发者和医疗AI监管者

深度学习在胸部X光诊断中表现优异,但其黑箱特性限制了临床应用。本文提出CXR-LanIC,一种基于语言对齐的可解释分类框架。通过在MIMIC-CXR数据集的多模态嵌入上训练100个转码器,从生物医学CLIP分类器中提取约5000个单一语义的视觉模式,覆盖心脏、肺部、胸膜、结构、设备和伪影等类别。这些模式在具有特定影像特征的图像中表现出一致激活行为,使诊断结果可分解为20-50个可验证的可解释模式,并支持未来生成自然语言解释。该方法直接从面向具体诊断任务的模型中挖掘特征,确保可解释性与临床决策相关,实现高精度与可解释性的统一,推动更安全的临床部署。

原文摘要 · Abstract (English)

Deep learning models have achieved remarkable accuracy in chest X-ray diagnosis, yet their widespread clinical adoption remains limited by the black-box nature of their predictions. Clinicians require transparent, verifiable explanations to trust automated diagnoses and identify potential failure modes. We introduce CXR-LanIC (Language-Grounded Interpretable Classifier for Chest X-rays), a novel framework that addresses this interpretability challenge through task-aligned pattern discovery. Our approach trains transcoder-based sparse autoencoders on a BiomedCLIP diagnostic classifier to decompose medical image representations into interpretable visual patterns. By training an ensemble of 100 transcoders on multimodal embeddings from the MIMIC-CXR dataset, we discover approximately 5,000 monosemantic patterns spanning cardiac, pulmonary, pleural, structural, device, and artifact categories. Each pattern exhibits consistent activation behavior across images sharing specific radiological features, enabling transparent attribution where predictions decompose into 20-50 interpretable patterns with verifiable activation galleries. CXR-LanIC achieves competitive diagnostic accuracy on five key findings while providing the foundation for natural language explanations through planned large multimodal model annotation. Our key innovation lies in extracting interpretable features from a classifier trained on specific diagnostic objectives rather than general-purpose embeddings, ensuring discovered patterns are directly relevant to clinical decision-making, demonstrating that medical AI systems can be both accurate and interpretable, supporting safer clinical deployment through transparent, clinically grounded explanations.

可解释AI医学影像胸部X光视觉模式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。