用自然语言描述数据集,让模型参数可读可解释。
Explaining Datasets in Words: Statistical Models with Natural Language Parameters
- 用自然语言谓词参数化统计模型,直接表达数据特征。
- 通过梯度优化与语言模型提示,实现参数连续到离散的转化。
- 适用于文本与视觉任务,擅长解释复杂概念,适合需要可解释性的场景。
为理解海量数据,我们常拟合简化模型并解释其参数;例如对文本嵌入聚类后分析每簇均值。然而这些参数高维且难以解读。为此,我们提出一类新型统计模型(包括聚类、时间序列和分类模型),其参数由自然语言谓词定义。例如,关于新冠的文本簇可用谓词“讨论新冠”来描述。为有效学习此类模型,我们设计了一种模型无关算法:通过梯度下降优化谓词参数的连续松弛,并利用语言模型提示将其离散化。该框架应用于多种任务:用户聊天对话的分类、演化分析、不同语言模型性能对比、数学问题按子领域聚类,以及记忆点图像的视觉特征解释。框架兼具通用性,可扩展至文本与视觉领域,支持聚焦特定属性(如子领域),能解释经典方法(如n-gram分析)难以捕捉的复杂概念。
原文摘要 · Abstract (English)
To make sense of massive data, we often fit simplified models and then interpret the parameters; for example, we cluster the text embeddings and then interpret the mean parameters of each cluster. However, these parameters are often high-dimensional and hard to interpret. To make model parameters directly interpretable, we introduce a family of statistical models -- including clustering, time series, and classification models -- parameterized by natural language predicates. For example, a cluster of text about COVID could be parameterized by the predicate "discusses COVID". To learn these statistical models effectively, we develop a model-agnostic algorithm that optimizes continuous relaxations of predicate parameters with gradient descent and discretizes them by prompting language models (LMs). Finally, we apply our framework to a wide range of problems: taxonomizing user chat dialogues, characterizing how they evolve across time, finding categories where one language model is better than the other, clustering math problems based on subareas, and explaining visual features in memorable images. Our framework is highly versatile, applicable to both textual and visual domains, can be easily steered to focus on specific properties (e.g. subareas), and explains sophisticated concepts that classical methods (e.g. n-gram analysis) struggle to produce.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。