让视觉提示可解释,通过跨层语义原型提升模型可信度。
Exploring Interpretability for Visual Prompt Tuning with Cross-layer Concepts
- 用跨层语义原型替代抽象提示嵌入,实现可读性增强。
- 在细粒度分类任务上性能超越现有提示调优方法。
- 适合关注模型可解释性与知识发现的研究者使用。
视觉提示调优能高效适配预训练视觉基础模型至特定任务,但当前研究对这一方法的可解释性关注不足,而可解释性对提升AI可靠性及推动AI驱动的知识发现至关重要。本文提出首个可解释视觉提示调优框架(IVPT),不再学习抽象提示嵌入,而是引入跨层概念原型,将视觉提示与人类可理解的语义概念关联。这些原型为类别无关的图像区域对应语义,通过聚合各区域特征生成多层可解释提示,实现不同网络深度和语义粒度下的提示解释。在细粒度分类基准上的定性和定量评估表明,IVPT在可解释性与性能上均优于现有视觉提示调优方法及已有的可解释方法。
原文摘要 · Abstract (English)
Visual prompt tuning offers significant advantages for adapting pre-trained visual foundation models to specific tasks. However, current research provides limited insight into the interpretability of this approach, which is essential for enhancing AI reliability and enabling AI-driven knowledge discovery. In this paper, rather than learning abstract prompt embeddings, we propose the first framework, named Interpretable Visual Prompt Tuning (IVPT), to explore interpretability for visual prompts by introducing cross-layer concept prototypes. Specifically, visual prompts are linked to human-understandable semantic concepts, represented as a set of category-agnostic prototypes, each corresponding to a specific region of the image. IVPT then aggregates features from these regions to generate interpretable prompts for multiple network layers, allowing the explanation of visual prompts at different network depths and semantic granularities. Comprehensive qualitative and quantitative evaluations on fine-grained classification benchmarks show its superior interpretability and performance over visual prompt tuning methods and existing interpretable methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。