arXiv:2411.16198cs.CV2024-11CVPR被引 29

提出视觉精确定位方法,精准找出模型决策关键区域。

Interpreting Object-level Foundation Models via Visual Precision Search

  • 通过稀疏子区域划分与一致性评分,避开模型参数直接定位
  • 在多个数据集上提升模型可解释性,最高忠实度提升102.9%
  • 适用于分析模型误判,适合研究可解释AI的开发者

多模态预训练推动了对象级基础模型(如Grounding DINO和Florence-2)在视觉定位与目标检测任务中的发展。然而,这些模型决策的可解释性日益困难。现有可解释性方法存在明显局限:梯度法因多模态融合导致定位不精确,扰动法产生噪声显著影响细粒度解释。为此,本文提出视觉精确定位(Visual Precision Search)方法,生成更少区域但更准确的归因图。该方法绕过模型内部参数,将输入划分为稀疏子区域,利用一致性和协作评分精准识别关键决策区域。我们还进行了边界保证与适用范围的理论分析。在RefCOCO、MS COCO和LVIS上的实验表明,该方法在多个评估指标上优于当前最优方法,针对Grounding DINO,MS COCO、LVIS和RefCOCO的忠实度分别提升23.7%、31.6%和20.1%;针对Florence-2,MS COCO和RefCOCO的忠实度分别提升102.9%和66.9%。此外,该方法能有效解析视觉定位与目标检测任务中的失败案例,表现全面领先。代码将在https://github.com/RuoyuChen10/VPS发布。

原文摘要 · Abstract (English)

Advances in multimodal pre-training have propelled object-level foundation models, such as Grounding DINO and Florence-2, in tasks like visual grounding and object detection. However, interpreting these models' decisions has grown increasingly challenging. Existing interpretable attribution methods for object-level task interpretation have notable limitations: (1) gradient-based methods lack precise localization due to visual-textual fusion in foundation models, and (2) perturbation-based methods produce noisy saliency maps, limiting fine-grained interpretability. To address these, we propose a Visual Precision Search method that generates accurate attribution maps with fewer regions. Our method bypasses internal model parameters to overcome attribution issues from multimodal fusion, dividing inputs into sparse sub-regions and using consistency and collaboration scores to accurately identify critical decision-making regions. We also conducted a theoretical analysis of the boundary guarantees and scope of applicability of our method. Experiments on RefCOCO, MS COCO, and LVIS show our approach enhances object-level task interpretability over SOTA for Grounding DINO and Florence-2 across various evaluation metrics, with faithfulness gains of 23.7%, 31.6%, and 20.1% on MS COCO, LVIS, and RefCOCO for Grounding DINO, and 102.9% and 66.9% on MS COCO and RefCOCO for Florence-2. Additionally, our method can interpret failures in visual grounding and object detection tasks, surpassing existing methods across multiple evaluation metrics. The code will be released at https://github.com/RuoyuChen10/VPS.

可解释AI视觉定位归因分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。