arXiv:2603.10409cs.IR2026-03被引 1

让生成式检索同时支持可微索引与几何稳定,解决传统方法的梯度断层和热门项压制问题。

Differentiable Geometric Indexing for End-to-End Generative Retrieval

  • 用可微的Gumbel-Softmax实现索引与检索端的联合优化
  • 在单位超球面上使用缩放余弦相似度,缓解热门项主导问题
  • 适合追求长尾召回性能的工业级搜索系统

生成式检索(GR)作为一种统一索引与搜索的范式崭露头角。然而现有方法存在两个固有矛盾:(1) 优化阻塞——离散索引的不可微性导致梯度中断,使索引构建与下游检索目标脱节;(2) 几何冲突——标准未归一化内积目标引发范数膨胀不稳定性,使热门项在几何上压倒相关长尾项。为系统化解耦,我们提出可微几何索引(DGI)。首先,通过Gumbel-Softmax实现软教师强制,建立完全可微路径,并结合对称权重共享,使量化器的索引空间与解码器空间对齐。其次,引入各向同性几何优化,将内积逻辑替换为单位超球面上的缩放余弦相似度,有效解耦流行度偏置与语义相关性。在大规模工业搜索数据集及线上电商平台上的实验表明,DGI显著优于主流稀疏、密集与生成基线。尤其在长尾场景下表现更优,验证了结构可微性与几何各向同性协同的必要性。

原文摘要 · Abstract (English)

Generative Retrieval (GR) has emerged as a promising paradigm to unify indexing and search within a single probabilistic framework. However, existing approaches suffer from two intrinsic conflicts: (1) an Optimization Blockage, where the non-differentiable nature of discrete indexing creates a gradient blockage, decoupling index construction from the downstream retrieval objective; and (2) a Geometric Conflict, where standard unnormalized inner-product objectives induce norm-inflation instability, causing popular "hub" items to geometrically overshadow relevant long-tail items. To systematically resolve these misalignments, we propose Differentiable Geometric Indexing (DGI). First, to bridge the optimization gap, DGI enforces Operational Unification. It employs Soft Teacher Forcing via Gumbel-Softmax to establish a fully differentiable pathway, combined with Symmetric Weight Sharing to effectively align the quantizer's indexing space with the retriever's decoding space. Second, to restore geometric fidelity, DGI introduces Isotropic Geometric Optimization. We replace inner-product logits with scaled cosine similarity on the unit hypersphere to effectively decouple popularity bias from semantic relevance. Extensive experiments on large-scale industry search datasets and online e-commerce platform demonstrate that DGI outperforms competitive sparse, dense, and generative baselines. Notably, DGI exhibits superior robustness in long-tail scenarios, validating the necessity of harmonizing structural differentiability with geometric isotropy.

生成式检索可微索引长尾召回几何优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。