arXiv:2503.13429cs.CV2025-03被引 2

让3D神经物体模型既可解释又抗分布外数据干扰

Interpretable 3D Neural Object Volumes for Robust Conceptual Reasoning

  • 从3D物体体积中学习稀疏概念,实现内在可解释性
  • 在多种分布外场景下保持高分类性能与概念一致性
  • 提出3D-C度量,用真实网格比较不同方法的解释空间一致性

随着深度神经网络在安全关键应用中的普及,鲁棒性和可解释性对确保其可信度至关重要。近年来,基于3D感知的分类器将图像特征映射为物体的体素表示,而非仅依赖2D外观,显著提升了分布外(OOD)数据下的鲁棒性。然而,这类方法尚未从可解释性角度进行研究。同时,现有基于概念的XAI方法常忽视OOD鲁棒性。本文提出CAVE——概念感知体积分解用于解释,统一了可解释性与鲁棒性。CAVE是一种鲁棒且内在可解释的分类器,从3D物体表示中学习稀疏概念。我们进一步提出3D一致性(3D-C)度量,通过真实物体网格作为公共表面投影并比较不同方法的解释空间一致性。该度量无需人工标注部件。CAVE在多种分布外设置下实现了有竞争力的分类性能,并发现一致且有意义的概念。代码已开源:https://github.com/phamleyennhi/CAVE。

原文摘要 · Abstract (English)

With the rise of deep neural networks, especially in safety-critical applications, robustness and interpretability are crucial to ensure their trustworthiness. Recent advances in 3D-aware classifiers that map image features to volumetric representation of objects, rather than relying solely on 2D appearance, have greatly improved robustness on out-of-distribution (OOD) data. Such classifiers have not yet been studied from the perspective of interpretability. Meanwhile, current concept-based XAI methods often neglect OOD robustness. We aim to address both aspects with CAVE - Concept Aware Volumes for Explanations - a new direction that unifies interpretability and robustness in image classification. We design CAVE as a robust and inherently interpretable classifier that learns sparse concepts from 3D object representation. We further propose 3D Consistency (3D-C), a metric to measure spatial consistency of concepts. Unlike existing metrics that rely on human-annotated parts on images, 3D-C leverages ground-truth object meshes as a common surface to project and compare explanations across concept-based methods. CAVE achieves competitive classification performance while discovering consistent and meaningful concepts across images in various OOD settings. Code available at https://github.com/phamleyennhi/CAVE.

可解释性3D神经表征鲁棒性概念分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。