arXiv:2602.03306cs.IRcs.AI2026-02ACL被引 1

让检索模型自动选出对当前查询有用的向量维度,提升精准度。

Learning to Select: Query-Aware Adaptive Dimension Selection for Dense Retrieval

  • 直接从查询向量学习每个维度的重要性,不依赖伪相关反馈。
  • 在多个数据集上比全维基线和现有方法提升检索效果,最高增益达2.1%的Recall@10。
  • 适合需要高效精准检索的场景,如搜索引擎、问答系统。

稠密检索将查询和文档表示为高维嵌入,但这些表示在查询层面可能存在冗余:对于特定信息需求,仅有部分维度对排序持续有效。以往工作通过基于伪相关反馈(PRF)的维度重要性估计来解决,虽无需标注数据但常依赖噪声伪信号和启发式推理过程。相比之下,监督适配器方法利用相关性标签提升嵌入质量,但学习的是跨查询共享的全局变换,未显式建模查询感知的维度重要性。本文提出查询感知自适应维度选择框架,直接从查询嵌入学习每个维度的重要性。首先使用监督相关性标签构建嵌入维度的最优重要性分布,再训练预测器将查询嵌入映射到这些标签提炼的重要性得分。推理时,仅凭查询嵌入即可选出查询相关的维度子集进行相似性计算,无需伪相关反馈。在多个稠密检索器和基准测试上的实验表明,所提出的维度选择器在召回率等指标上显著优于全维基线、基于PRF的掩码方法及监督适配器基线。

原文摘要 · Abstract (English)

Dense retrieval represents queries and documents as high-dimensional embeddings, but these representations can be redundant at the query level: for a given information need, only a subset of dimensions is consistently helpful for ranking. Prior work addresses this via pseudo-relevance feedback (PRF) based dimension importance estimation, which can produce query-aware masks without labeled data but often relies on noisy pseudo signals and heuristic test-time procedures. In contrast, supervised adapter methods leverage relevance labels to improve embedding quality, yet they learn global transformations shared across queries and do not explicitly model query-aware dimension importance. We propose a Query-Aware Adaptive Dimension Selection framework that \emph{learns} to predict per-dimension importance directly from query embedding. We first construct oracle dimension importance distributions over embedding dimensions using supervised relevance labels, and then train a predictor to map a query embedding to these label-distilled importance scores. At inference, the predictor selects a query-aware subset of dimensions for similarity computation based solely on the query embedding, without pseudo-relevance feedback. Experiments across multiple dense retrievers and benchmarks show that our learned dimension selector improves retrieval effectiveness over the full-dimensional baseline as well as PRF-based masking and supervised adapter baselines.

稠密检索维度选择查询感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。