arXiv:2410.19349cs.IRcs.AI2024-10EMNLP被引 4

用概率模型动态调整检索阈值,提升长尾查询的召回率和整体精度。

pEBR: A Probabilistic Approach to Embedding Based Retrieval

  • 基于概率建模查询与物品的分布关系,实现动态相似度阈值
  • 在真实工业数据上,召回率与精度均显著优于固定数量检索
  • 特别适合处理头部与尾部查询差异大的场景,如推荐系统

基于嵌入的检索旨在为查询和物品学习一个共享语义表示空间,通过近似最近邻(ANN)算法实现高效且有效的物品检索。当前工业实践中,检索系统通常对每个查询返回固定数量的物品,但这种固定大小的检索常导致头部查询召回不足、尾部查询精度偏低。这一局限主要源于损失函数设计中频繁使用频率主义方法,未能有效应对实际工业场景中的挑战。本文提出一种新的概率嵌入式检索框架(pEBR)。该方法建模每个查询条件下的物品分布,从而利用概率模型的累积分布函数(CDF)生成动态余弦相似度阈值。实验结果表明,pEBR 显著提升了检索精度与召回率。消融研究进一步显示,概率形式能有效捕捉头部与尾部查询间的内在差异。

原文摘要 · Abstract (English)

Embedding-based retrieval aims to learn a shared semantic representation space for both queries and items, enabling efficient and effective item retrieval through approximate nearest neighbor (ANN) algorithms. In current industrial practice, retrieval systems typically retrieve a fixed number of items for each query. However, this fixed-size retrieval often results in insufficient recall for head queries and low precision for tail queries. This limitation largely stems from the dominance of frequentist approaches in loss function design, which fail to address this challenge in industry. In this paper, we propose a novel \textbf{p}robabilistic \textbf{E}mbedding-\textbf{B}ased \textbf{R}etrieval (\textbf{pEBR}) framework. Our method models the item distribution conditioned on each query, enabling the use of a dynamic cosine similarity threshold derived from the cumulative distribution function (CDF) of the probabilistic model. Experimental results demonstrate that pEBR significantly improves both retrieval precision and recall. Furthermore, ablation studies reveal that the probabilistic formulation effectively captures the inherent differences between head-to-tail queries.

检索概率建模嵌入推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。