arXiv:2605.29507cs.AIcs.IR2026-05被引 1

让密集检索的决策过程可解释,从嵌入空间揭示推理逻辑。

Xetrieval: Mechanistically Explaining Dense Retrieval

论文配图:Xetrieval: Mechanistically Explaining Dense Retrieval
图 1 · 摘自论文原文
  • 在嵌入空间直接模拟思维链,单次前向传播生成推理信息。
  • 分解嵌入为可读特征,跨文档视图聚合实现细粒度解释。
  • 适合需要理解检索逻辑的研究者与工程师,提升模型可信度。

解释密集检索器为何赋予高相关性评分仍具挑战性,因检索决策依赖于高维嵌入中的黑箱机制。现有方法多关注表层信号,如词汇匹配或后验文本理由,难以揭示嵌入层面的潜在影响因素。本文提出Xetrieval,一种嵌入级机械解释框架:首先引入轻量级推理内化模块,在单次前向传播中直接于嵌入空间近似思维链推理,增强句子嵌入的推理信息,避免昂贵的自回归生成;随后将这些增强嵌入分解为稀疏、人类可读的特征,每项对应清晰自然语言描述。通过聚合多个文档侧视图的稀疏特征重叠,Xetrieval提供个体检索决策的特征级解释。在多种检索器与基准测试上的实验表明,该方法能揭示连贯可解释特征,产生更强的成对干预效果,并支持任务级特征引导。项目页面与源码见https://hihiczx.github.io/Xetrieval。

原文摘要 · Abstract (English)

Explaining why dense retrievers assign high relevance scores remains challenging because retrieval decisions are made through opaque high-dimensional embeddings. Existing explanations often focus on surface signals, such as lexical matches, token alignments, or post-hoc textual rationales, and thus provide limited insight into the latent factors that shape dense retrieval behavior at the embedding level. We propose \textit{Xetrieval}, an embedding-level mechanistic framework for explaining dense retrieval. \textit{Xetrieval} first introduces a lightweight reasoning internalizer that approximates Chain-of-Thought reasoning directly in the embedding space with a single forward pass, enriching sentence embeddings with reasoning-oriented information while avoiding expensive autoregressive generation. It then decomposes these reasoning-enhanced embeddings into sparse, human-interpretable features, each associated with a coherent natural language description. By aggregating sparse feature overlaps across multiple document-side views, \textit{Xetrieval} provides feature-level explanations of individual retrieval decisions. Experiments on diverse retrievers and benchmarks show that \textit{Xetrieval} uncovers coherent interpretable features, yields stronger pair-level intervention effects, and supports task-level feature steering. The project page and source code are available at https://hihiczx.github.io/Xetrieval .

可解释性检索系统嵌入解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。