用语言模型生成可解释的视觉属性树,无需重新训练模型。
Language Model as Visual Explainer
- 用LLM构建分层视觉属性树,结合文生图API对齐概念。
- 通过嵌入空间映射动态调整解释结构,支持新属性增删。
- 生成可理解的解释树,还能用于模型知识校准。
本文提出语言模型作为视觉解释器(LVX),一种无需模型训练即可解释视觉模型内部机制的系统性方法。核心是视觉模型与大语言模型协作生成树状语言解释。一方面,LLM定义分层视觉属性;另一方面,文本到图像API生成与这些概念最匹配的图像。将收集到的文本和图像映射至视觉模型的嵌入空间,构建层次化视觉嵌入树。通过语言模板查询LLM,动态修剪或扩展该树,使解释适配具体模型。此方法可在不改变原模型的情况下引入新属性或剔除无关概念。应用于测试样本时,输出带有属性标签的可读解释树。此外,还可基于生成的概念层次重新校准视觉模型,使其吸收优化后的视觉属性知识。为评估有效性,我们引入新基准并进行严格实验,验证了方法在合理性、忠实性和稳定性方面的优势。
原文摘要 · Abstract (English)
In this paper, we present Language Model as Visual Explainer LVX, a systematic approach for interpreting the internal workings of vision models using a tree-structured linguistic explanation, without the need for model training. Central to our strategy is the collaboration between vision models and LLM to craft explanations. On one hand, the LLM is harnessed to delineate hierarchical visual attributes, while concurrently, a text-to-image API retrieves images that are most aligned with these textual concepts. By mapping the collected texts and images to the vision model's embedding space, we construct a hierarchy-structured visual embedding tree. This tree is dynamically pruned and grown by querying the LLM using language templates, tailoring the explanation to the model. Such a scheme allows us to seamlessly incorporate new attributes while eliminating undesired concepts based on the model's representations. When applied to testing samples, our method provides human-understandable explanations in the form of attribute-laden trees. Beyond explanation, we retrained the vision model by calibrating it on the generated concept hierarchy, allowing the model to incorporate the refined knowledge of visual attributes. To access the effectiveness of our approach, we introduce new benchmarks and conduct rigorous evaluations, demonstrating its plausibility, faithfulness, and stability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。