arXiv:2504.17519cs.IR2025-04中稿 · SIGIR 2025被引 15

对比了生成式检索在动态文档库中的表现,发现文本类文档ID更优。

Replication and Exploration of Generative Retrieval over Dynamic Corpora

  • 用文本型文档ID的生成式检索模型在动态数据中泛化能力更强
  • 细粒度文本ID性能超越BM25,接近稠密检索方法
  • 提出新多文档ID设计,兼顾效率与效果,无需重新训练

生成式检索(GR)已成为信息检索领域的重要范式,但现有模型大多基于静态文档集合进行训练与评估,其在持续演化的动态文档库中的表现鲜有研究。本文首次系统复现并评估多种代表性GR方法在动态语料上的表现。实验表明,采用文本型文档ID的GR模型对未见文档具有更强的泛化能力;文档ID越细粒度,模型在动态环境中的表现越好,甚至超过BM25,接近稠密检索水平。而基于数值型文档ID的模型虽高效,但在动态语料上性能显著下降,主要因过度依赖初始文档集,存在过拟合问题。深入分析发现,文本型文档ID的优势在于:(i) 与语言模型预训练知识语义对齐,(ii) 支持细粒度设计,(iii) 具有高词汇多样性。基于此,我们提出一种新型多文档ID机制,结合数值型与文本型优点,在不需额外训练的前提下提升了动态语料下的性能。本工作为构建更通用且高效的现实搜索系统中的生成式检索模型提供了实证支持。

原文摘要 · Abstract (English)

Generative retrieval (GR) has emerged as a promising paradigm in information retrieval (IR). However, most existing GR models are developed and evaluated using a static document collection, and their performance in dynamic corpora where document collections evolve continuously is rarely studied. In this paper, we first reproduce and systematically evaluate various representative GR approaches over dynamic corpora. Through extensive experiments, we reveal that existing GR models with \textit{text-based} docids show superior generalization to unseen documents. We observe that the more fine-grained the docid design in the GR model, the better its performance over dynamic corpora, surpassing BM25 and even being comparable to dense retrieval methods. While GR models with \textit{numeric-based} docids show high efficiency, their performance drops significantly over dynamic corpora. Furthermore, our experiments find that the underperformance of numeric-based docids is partly due to their excessive tendency toward the initial document set, which likely results from overfitting on the training set. We then conduct an in-depth analysis of the best-performing GR methods. We identify three critical advantages of text-based docids in dynamic corpora: (i) Semantic alignment with language models' pretrained knowledge, (ii) Fine-grained docid design, and (iii) High lexical diversity. Building on these insights, we finally propose a novel multi-docid design that leverages both the efficiency of numeric-based docids and the effectiveness of text-based docids, achieving improved performance in dynamic corpus without requiring additional retraining. Our work offers empirical evidence for advancing GR methods over dynamic corpora and paves the way for developing more generalized yet efficient GR models in real-world search engines.

生成式检索动态文档文档编码信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。