用大模型生成数据描述,让机器理解数据更直观。
Data Descriptions from Large Language Models with Influence Estimation
- 用大模型结合外部知识生成数据的自然语言描述。
- 通过影响度估计筛选最相关描述,在9个图像数据集上提升模型性能。
- 适合想理解模型决策过程的研究者与开发者。
深度学习模型在多个领域取得成功,但其行为仍像黑箱。现有可解释AI方法多关注模型预测逻辑,而本文提出从数据角度理解模型训练过程,利用语言这一常见媒介,借助大语言模型生成数据的文本描述,并引入外部知识库增强解释性。为解决生成内容冗余问题,采用影响度估计与CLIP分数筛选最具信息量的描述。基于跨模态可迁移性,设计了新的基准任务——跨模态迁移分类,用于评估描述效果。零样本实验表明,本文生成的描述优于其他基线,在全部9个图像分类数据集上均显著提升仅用图像训练模型的性能。GPT-4o评估进一步验证结果可靠性。该方法有助于揭示模型决策背后的内在可解释性。
原文摘要 · Abstract (English)
Deep learning models have been successful in many areas but understanding their behaviors still remains a black-box. Most prior explainable AI (XAI) approaches have focused on interpreting and explaining how models make predictions. In contrast, we would like to understand how data can be explained with deep learning model training and propose a novel approach to understand the data via one of the most common media - language - so that humans can easily understand. Our approach proposes a pipeline to generate textual descriptions that can explain the data with large language models by incorporating external knowledge bases. However, generated data descriptions may still include irrelevant information, so we introduce to exploit influence estimation to choose the most informative textual descriptions, along with the CLIP score. Furthermore, based on the phenomenon of cross-modal transferability, we propose a novel benchmark task named cross-modal transfer classification to examine the effectiveness of our textual descriptions. In the experiment of zero-shot setting, we show that our textual descriptions are more effective than other baseline descriptions, and furthermore, we successfully boost the performance of the model trained only on images across all nine image classification datasets. These results are further supported by evaluation using GPT-4o. Through our approach, we may gain insights into the inherent interpretability of the decision-making process of the model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。