arXiv:2605.22547cs.CVcs.AI2026-05

用多模态知识图谱增强医学影像诊断,实现可解释的案例推理。

MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis

论文配图:MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis
图 1 · 摘自论文原文
  • 构建病例驱动的多模态知识图谱作为诊断记忆库。
  • 通过图注意力网络融合相似病例信息,提升诊断准确率。
  • 支持可解释的病例证据追溯,适合临床辅助决策场景。

医学图像诊断在深度学习推动下取得显著进展,但现有方法多依赖孤立的视觉证据,难以有效利用历史病例和外部知识。临床诊断通常基于相似病例及其症状。为此,我们提出MKG-CARE框架,通过多模态知识图谱实现案例感知的可解释医学图像诊断。具体地,构建层次化结构的案例感知多模态知识图谱,包含疾病、图像与症状。给定输入图像,MKG-CARE自适应检索相似病例并提取其对应的子图;引入知识传播与注入机制,通过图像中心的图注意力网络聚合异构语义,并利用双向跨模态注意力将病例知识对齐并注入视觉表征;为缓解检索噪声,设计置信度校准的决策精炼方案,根据预测置信度与样本相似性估计每个病例的可靠性,重加权其对最终预测的贡献,实现可解释的病例级证据归属。在多个医学影像数据集上的实验表明,该方法持续优于强基线,消融与定性分析验证了其有效性和可解释性。代码已公开于https://github.com/lyxuan1022/MKG-CARE。

原文摘要 · Abstract (English)

Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge. In clinical practice, diagnosis is typically supported by similar historical cases and their associated symptoms. To explicitly model this evidence-based diagnostic process, we propose MKG-CARE, a framework that performs case-aware reasoning using multimodal knowledge graphs for explainable medical image diagnosis. Specifically, we construct a case-aware multimodal knowledge graph as a structured diagnostic memory, where diseases, images, and symptoms are hierarchically organized. Given an input image, MKG-CARE adaptively retrieves similar cases from this memory and extracts their corresponding case-centered subgraphs. We further introduce a knowledge propagation and injection mechanism, where an image-centric Graph Attention Network aggregates heterogeneous semantics within the retrieved case subgraphs, followed by bidirectional cross-modal attention to align and inject the aggregated case knowledge into visual representations. To mitigate retrieval noise, we design a confidence-calibrated decision refinement scheme that estimates each retrieved case's reliability from prediction confidence and sample similarity, and reweights its contribution to the final prediction for interpretable case-level evidence attribution. Extensive experiments on multiple medical imaging datasets demonstrate consistent improvements over strong baselines, while ablation and qualitative analyses validate the effectiveness and interpretability of our method. The code is available at https://github.com/lyxuan1022/MKG-CARE.

医学影像可解释性知识图谱案例推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。