arXiv:2411.04008cs.CVcs.AI2024-11

用图像特征描述生成专家级解释,提升模型可信赖度

Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability

  • 引入概念瓶颈层,比对图像与描述编码相似性
  • 在人脸与胸片诊断中优于传统显著图方法
  • 适合法律、医疗等高风险场景的可解释性需求

在执法和医疗诊断等关键领域,深度学习模型的可解释性对于建立用户信任和辅助决策至关重要。尽管可解释性研究取得进展,现有方法仍难以提供类人专家般深入清晰的解释。真实场景中的解释主要依赖自然语言。为此,我们提出一种新方法:通过识别图像中是否存在特征描述来解释模型决策,生成类专家解释。该方法在模型架构中引入概念瓶颈层,计算图像与描述编码间的相似性,实现内在且忠实的解释。在人脸识别和胸部X光诊断任务中,实验表明该方法显著优于仅依赖显著图的现有技术。本工作为提升深度学习系统在人脸识别和医疗诊断等关键领域的可问责性、透明性和可信度迈出重要一步。

原文摘要 · Abstract (English)

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite advancements in explainability, existing methods often fall short in providing explanations that mirror the depth and clarity of those given by human experts. Such expert-level explanations are essential for the dependable application of deep learning models in law enforcement and medical contexts. Additionally, we recognize that most explanations in real-world scenarios are communicated primarily through natural language. Addressing these needs, we propose a novel approach that utilizes characteristic descriptors to explain model decisions by identifying their presence in images, thereby generating expert-like explanations. Our method incorporates a concept bottleneck layer within the model architecture, which calculates the similarity between image and descriptor encodings to deliver inherent and faithful explanations. Through experiments in face recognition and chest X-ray diagnosis, we demonstrate that our approach offers a significant contrast over existing techniques, which are often limited to the use of saliency maps. We believe our approach represents a significant step toward making deep learning systems more accountable, transparent, and trustworthy in the critical domains of face recognition and medical diagnosis.

可解释性专家级解释医疗诊断特征描述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。