用光滑轮廓替代密集掩码,让视觉模型解释更紧凑可信。
Extremal Contours: Gradient-driven contours for compact visual attribution
- 用截断傅里叶级数参数化星凸区域,通过梯度优化生成平滑轮廓
- 在ImageNet上达到与密集掩码相当的忠实度,且轮廓更紧凑稳定
- 适用于多目标定位,尤其对自监督DINO模型效果提升超15%
视觉模型的可靠且紧凑的解释仍具挑战性,因常用密集扰动掩码常呈碎片状且过拟合,需复杂后处理。本文提出一种无需训练的解释方法,以平滑可调轮廓替代密集掩码。采用截断傅里叶级数参数化星凸区域,在分类器梯度驱动下,基于极值保留/删除目标进行优化。该方法保证单一、单连通掩码,自由参数数量减少数个量级,边界更新稳定无需清理。将解限制在低维平滑轮廓中,使方法对对抗性遮蔽伪影具有鲁棒性。在ImageNet分类器上,其极值忠实度与密集掩码相当,同时生成紧凑可解释区域,运行间一致性显著提升。显式面积控制还支持重要性轮廓图,实现透明的忠实事物-面积曲线。最后,将方法扩展至多轮廓,可在同一框架内定位多个物体。在多个基准测试中,该方法比基于梯度和扰动的基线具有更高的相关质量与更低的复杂度,尤其在自监督DINO模型上,相关质量提升超过15%,并保持正向忠实度相关性。
原文摘要 · Abstract (English)
Faithful yet compact explanations for vision models remain a challenge, as commonly used dense perturbation masks are often fragmented and overfitted, needing careful post-processing. Here, we present a training-free explanation method that replaces dense masks with smooth tunable contours. A star-convex region is parameterized by a truncated Fourier series and optimized under an extremal preserve/delete objective using the classifier gradients. The approach guarantees a single, simply connected mask, cuts the number of free parameters by orders of magnitude, and yields stable boundary updates without cleanup. Restricting solutions to low-dimensional, smooth contours makes the method robust to adversarial masking artifacts. On ImageNet classifiers, it matches the extremal fidelity of dense masks while producing compact, interpretable regions with improved run-to-run consistency. Explicit area control also enables importance contour maps, yielding a transparent fidelity-area profiles. Finally, we extend the approach to multi-contour and show how it can localize multiple objects within the same framework. Across benchmarks, the method achieves higher relevance mass and lower complexity than gradient and perturbation based baselines, with especially strong gains on self-supervised DINO models where it improves relevance mass by over 15% and maintains positive faithfulness correlations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。