用零样本文生图生成概念数据,提升可解释AI的可扩展性。
A Framework for Evaluating Zero-Shot Image Generation in Concept-based Explainability

- 用预设提示词生成合成概念图像,替代真实标注数据。
- 合成概念在表征相似性和下游解释任务中表现接近真实数据。
- 适合研究可解释AI中概念生成与合成数据可信度的学者。
基于概念的可解释人工智能(XAI)通过将深层神经网络内部表征与人类可理解的视觉特征(如纹理或物体部件)关联,弥合低层图像数据与高层语义之间的差距。然而,现有方法严重依赖大量标注图像来表示每个概念,限制了可扩展性。本文探索使用零样本文生图(T2I)生成模型作为合成概念数据集的来源。具体地,通过预设提示词生成概念,并通过四项互补分析评估其对真实概念的忠实度:(1) 比较合成与真实概念图像的概念表征相似性;(2) 通过逐步增大同概念子集数量,评估其内部相似性;(3) 在相关类别图像上测试其在下游解释任务中的性能;(4) 分析移除某概念后对生成概念解释的影响。尽管当前T2I模型为概念驱动的XAI提供了捷径,但本研究揭示了合成数据在模型分析中仍存在挑战,并提出开放问题。相关数据集已公开于 https://github.com/DataSciencePolimi/ZeroShot-T2I-Concepts。
原文摘要 · Abstract (English)
Concept-based Explainable Artificial Intelligence (XAI) interprets deep learning models using human-understandable visual features (e.g., textures or object parts) by linking internal representations to class predictions, thereby bridging the gap between low-level image data and high-level semantics. A major challenge, however, is the reliance on large sets of labeled images to represent each concept, which limits scalability. In this work, we investigate the use of zero-shot Text-to-Image (T2I) generative models as a source of synthetic concept datasets for concept-based XAI methods. Specifically, we generate concepts using predefined prompts and evaluate their faithfulness to real ones through four complementary analyses: (1) comparing synthetic vs. real concept images via concept representation similarity; (2) evaluating their intra-similarity by comparing pairs of subsets of the same concept with progressively increasing size; (3) evaluating their performance for downstream explanation tasks using relevant class images; (4) evaluating how removing a concept from tested class images affects explanations of generated concepts. While current T2I generative models promise a shortcut to concept-based XAI, our study highlights challenges and raises open questions about the use of synthetic data generated by zero-shot pipelines in model analyses. The resulting dataset is available at https://github.com/DataSciencePolimi/ZeroShot-T2I-Concepts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。