arXiv:2609.05110cs.IR2026-09

通过局部微调文档嵌入,实现搜索结果的实时自适应优化。

Embedding Surgery: Localized Updates for Adaptive Ranking Correction in Dense Retrieval

  • 在查询时对特定文档嵌入做最小化修改,依据用户反馈或大模型伪标签。
  • 在多个基准上提升排序效果,最高相对增益达60.64%(nDCG@10)。
  • 适合需要快速响应用户行为变化的搜索与推荐系统。

密集检索系统是现代搜索引擎、推荐平台和检索增强生成流水线的核心组件。它们将文档和查询编码为稠密嵌入,通过向量相似性实现高效语义搜索。然而,由于文档嵌入离线计算并存储于静态索引中,系统难以适应用户反馈或不断演变的搜索意图。为此,我们提出「嵌入手术」(embedding surgery),一种轻量级的密集检索自适应排序修正方法。该方法在查询时对选定文档嵌入进行局部、最小化更新,依据编辑反馈、用户交互或大语言模型生成的伪标签。我们将嵌入手术建模为凸优化问题,强制满足排序约束的同时最小化对文档表示的修改。将其集成至标准密集检索流程,在TREC Deep Learning、TREC Robust、TREC CAsT和MS MARCO等基准上评估,结果表明其持续提升性能(例如,在DL-Hard任务下,编辑反馈场景中nDCG@10相对提升高达60.64%),即使面对噪声或漂移的反馈也表现稳健,且计算成本极低,不破坏嵌入空间全局结构。大量实验显示,排序修正可传播至语义相关查询;嵌入更新可通过简单就地覆盖安全高效地应用于可扩展的近似最近邻索引,无需昂贵的索引重建。此外,嵌入手术可与查询适配方法(如CoRocchio)互补,在保持更强抗噪性的同时带来额外性能增益。

原文摘要 · Abstract (English)

Dense retrieval systems are core components of modern search engines, recommendation platforms, and retrieval-augmented generation pipelines. They encode documents and queries into dense embeddings, enabling efficient semantic search via vector similarity. However, because document embeddings are computed offline and stored in static indexes, these systems struggle to adapt to user feedback or evolving search intent. To address this limitation, we introduce \emph{embedding surgery}, a lightweight approach for adaptive ranking correction in dense retrieval. The method applies localized, minimal updates to selected document embeddings at query time, guided by editorial feedback, user interactions, or pseudo-labels from large language models. We formulate embedding surgery as a convex optimization problem that enforces ranking constraints while minimizing modifications to the affected document representations. We integrate embedding surgery into standard dense retrieval pipelines and evaluate it on TREC Deep Learning, TREC Robust, TREC CAsT, and MS MARCO benchmarks. Results show consistent improvements (e.g., up to +60.64\% relative improvement in nDCG@10 on DL-Hard under editorial feedback), even under noisy or shifting feedback, with low computational cost and without disrupting the global structure of the embedding space. Extensive experiments show that ranking corrections propagate to semantically related queries and that embedding updates can be applied safely and efficiently to scalable Approximate Nearest Neighbor indexes via simple in-place overwriting, without requiring costly index reconstruction. Finally, embedding surgery complements query adaptation methods such as CoRocchio, yielding additional gains while being more robust to noisy feedback.

稠密检索排序优化在线学习嵌入更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。