融合医生经验与深度学习,提升医学影像诊断的准确性与可解释性。
MedXAI: A Retrieval-Augmented and Self-Verifying Framework for Knowledge-Guided Medical Image Analysis
- 用临床知识作为先验约束深度模型,增强泛化能力。
- 跨域泛化提升3%,罕见病类别F1得分提高10%。
- 适合关注可解释性与罕见病诊断的医疗AI研究者。
准确且可解释的影像诊断仍是医学AI的核心挑战,尤其在领域偏移和罕见病情况下。深度学习模型常因真实世界分布变化而表现下降,对少见病理存在偏差,且缺乏临床部署所需的透明性。我们提出MedXAI(面向医学影像分类的可解释框架),一个融合深度视觉模型与医生经验知识的统一框架,通过定位相关诊断特征而非依赖技术后处理方法(如显著图、LIME),提升泛化能力、降低罕见病偏差,并提供人类可理解的解释。在两个挑战性任务上评估:(i) 静息态fMRI中癫痫发作起始区定位;(ii) 糖尿病视网膜病变分级。在十个多中心数据集上的实验显示,跨域泛化提升3%,罕见类别F1得分提升10%,显著优于强基线。消融实验证明符号化组件作为有效的临床先验和正则化项,提升了分布偏移下的鲁棒性。MedXAI在保证优异域内与跨域性能的同时,提供符合临床认知的解释,尤其适用于多模态医学AI中的罕见病诊断。
原文摘要 · Abstract (English)
Accurate and interpretable image-based diagnosis remains a fundamental challenge in medical AI, particularly under domain shifts and rare-class conditions. Deep learning models often struggle with real-world distribution changes, exhibit bias against infrequent pathologies, and lack the transparency required for deployment in safety-critical clinical environments. We introduce MedXAI (An Explainable Framework for Medical Imaging Classification), a unified expert knowledge based framework that integrates deep vision models with clinician-derived expert knowledge to improve generalization, reduce rare-class bias, and provide human-understandable explanations by localizing the relevant diagnostic features rather than relying on technical post-hoc methods (e.g., Saliency Maps, LIME). We evaluate MedXAI across heterogeneous modalities on two challenging tasks: (i) Seizure Onset Zone localization from resting-state fMRI, and (ii) Diabetic Retinopathy grading. Ex periments on ten multicenter datasets show consistent gains, including a 3% improvement in cross-domain generalization and a 10% improvmnet in F1 score of rare class, substantially outperforming strong deep learning baselines. Ablations confirm that the symbolic components act as effective clinical priors and regularizers, improving robustness under distribution shift. MedXAI delivers clinically aligned explanations while achieving superior in-domain and cross-domain performance, particularly for rare diseases in multimodal medical AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。