用可解释的问答生成高质量文本嵌入,无需专家干预。
A General Framework for Producing Interpretable Semantic Text Embeddings
- 通过对比问答生成法自动构造简单可读的问题。
- 在多个任务上达到黑箱模型水平的嵌入质量。
- 适合需要透明性与可解释性的NLP应用。
语义文本嵌入对自然语言处理诸多任务至关重要。尽管黑箱模型能生成高质量嵌入,但缺乏可解释性限制了其在需透明性的任务中的应用。现有方法依赖领域专家设计或大模型生成问题,受限于专家输入和提示设计,泛化能力差且难以生成具有区分性的提问。为此,我们提出 CQG-MBQA(对比问答生成-多任务二分类问答)框架,可在多种任务中系统生成高区分度、认知负荷低的是/否问题,并通过 MBQA 模型高效回答,实现低成本且可解释的嵌入生成。大量实验与消融研究验证了该框架的有效性与可解释性:其嵌入质量可媲美多项先进黑箱模型,同时保持内在可解释性;且在多个下游任务中优于其他可解释嵌入方法。
原文摘要 · Abstract (English)
Semantic text embedding is essential to many tasks in Natural Language Processing (NLP). While black-box models are capable of generating high-quality embeddings, their lack of interpretability limits their use in tasks that demand transparency. Recent approaches have improved interpretability by leveraging domain-expert-crafted or LLM-generated questions, but these methods rely heavily on expert input or well-prompt design, which restricts their generalizability and ability to generate discriminative questions across a wide range of tasks. To address these challenges, we introduce \algo{CQG-MBQA} (Contrastive Question Generation - Multi-task Binary Question Answering), a general framework for producing interpretable semantic text embeddings across diverse tasks. Our framework systematically generates highly discriminative, low cognitive load yes/no questions through the \algo{CQG} method and answers them efficiently with the \algo{MBQA} model, resulting in interpretable embeddings in a cost-effective manner. We validate the effectiveness and interpretability of \algo{CQG-MBQA} through extensive experiments and ablation studies, demonstrating that it delivers embedding quality comparable to many advanced black-box models while maintaining inherently interpretability. Additionally, \algo{CQG-MBQA} outperforms other interpretable text embedding methods across various downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。