用极少标注数据实现肺结节诊断,且能多层级自解释。
MERA: Multimodal and Multiscale Self-Explanatory Model with Considerably Reduced Annotation for Lung Nodule Diagnosis
- 融合自监督与半监督学习,仅需1%标注数据训练。
- 在LIDC数据集上准确率媲美全标注模型。
- 适合医疗AI落地,提升诊断可信度与透明性。
肺癌是全球癌症死亡的主要原因,早期检测对改善预后至关重要。肺部结节常为肺癌早期征兆,需精准及时诊断。尽管可解释人工智能(XAI)取得进展,现有系统在有限标注数据下仍难提供清晰、全面的解释。本文提出MERA:一种多模态、多尺度自解释模型,专为低标注需求的肺结节诊断设计。MERA结合自监督学习(利用Vision Transformer提取特征)与半监督主动学习,在稀疏标注条件下进行分层预测。其可提供多层次解释:模型级通过语义潜在空间聚类生成全局解释,实例级展示相似病例,局部通过注意力图可视化,概念级则基于关键结节属性进行说明。在公开数据集LIDC上的评估表明,仅使用1%标注样本,MERA的诊断准确率即可达到或超越需全量标注的先进方法。模型设计天然支持全面、稳健的多层级解释,高度契合临床实践,增强可信度与透明性。结果证明,无监督与弱监督学习在降低医疗AI部署门槛方面具有可行性。完整代码已开源:https://github.com/diku-dk/credanno。
原文摘要 · Abstract (English)
Lung cancer, a leading cause of cancer-related deaths globally, emphasises the importance of early detection for better patient outcomes. Pulmonary nodules, often early indicators of lung cancer, necessitate accurate, timely diagnosis. Despite Explainable Artificial Intelligence (XAI) advances, many existing systems struggle providing clear, comprehensive explanations, especially with limited labelled data. This study introduces MERA, a Multimodal and Multiscale self-Explanatory model designed for lung nodule diagnosis with considerably Reduced Annotation requirements. MERA integrates unsupervised and weakly supervised learning strategies (self-supervised learning techniques and Vision Transformer architecture for unsupervised feature extraction) and a hierarchical prediction mechanism leveraging sparse annotations via semi-supervised active learning in the learned latent space. MERA explains its decisions on multiple levels: model-level global explanations via semantic latent space clustering, instance-level case-based explanations showing similar instances, local visual explanations via attention maps, and concept explanations using critical nodule attributes. Evaluations on the public LIDC dataset show MERA's superior diagnostic accuracy and self-explainability. With only 1% annotated samples, MERA achieves diagnostic accuracy comparable to or exceeding state-of-the-art methods requiring full annotation. The model's inherent design delivers comprehensive, robust, multilevel explanations aligned closely with clinical practice, enhancing trustworthiness and transparency. Demonstrated viability of unsupervised and weakly supervised learning lowers the barrier to deploying diagnostic AI in broader medical domains. Our complete code is open-source available: https://github.com/diku-dk/credanno.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。