arXiv:2603.02773cs.IR2026-03中稿 · The Web Conference被引 4

让生成式检索模型快速学会新文档的编号,不需重训。

Model Editing for New Document Integration in Generative Information Retrieval

  • 通过可区分的编辑向量,精准修改模型对新文档的识别能力。
  • 在NQ和MS MARCO上,新文档召回率提升显著,原数据集性能不变。
  • 只需增量训练60%时间,适合频繁更新的场景。

生成式检索(GR)将信息检索任务转化为生成文档标识符(docID)的过程。现有GR模型在新增文档时泛化能力差,常无法生成正确docID。增量训练虽有效,但计算成本高且易遗忘旧知识。本文发现核心瓶颈在于解码器对新文档docID的映射能力。提出DOME(docID导向的模型编辑)方法,分三阶段:关键层识别、编辑向量优化、更新构建与应用。采用混合标签自适应训练,结合软标签保持查询语义差异,硬标签确保精确映射修正。在NQ和MS MARCO等基准上,DOME显著提升新文档检索效果,同时维持原有性能。仅需增量训练约60%时间,大幅降低计算开销,支持高效频繁更新。

原文摘要 · Abstract (English)

Generative retrieval (GR) reformulates the Information Retrieval (IR) task as the generation of document identifiers (docIDs). Despite its promise, existing GR models exhibit poor generalization to newly added documents, often failing to generate the correct docIDs. While incremental training offers a straightforward remedy, it is computationally expensive, resource-intensive, and prone to catastrophic forgetting, thereby limiting the scalability and practicality of GR. In this paper, we identify the core bottleneck as the decoder's ability to map hidden states to the correct docIDs of newly added documents. Model editing, which enables targeted parameter modifications for docID mapping, represents a promising solution. However, applying model editing to current GR models is not trivial, which is severely hindered by indistinguishable edit vectors across queries, due to the high overlap of shared docIDs in retrieval results. To address this, we propose DOME (docID-oriented model editing), a novel method that effectively and efficiently adapts GR models to unseen documents. DOME comprises three stages: (1) identification of critical layers, (2) optimization of edit vectors, and (3) construction and application of updates. At its core, DOME employs a hybrid-label adaptive training strategy that learns discriminative edit vectors by combining soft labels, which preserve query-specific semantics for distinguishable updates, with hard labels that enforce precise mapping modifications. Experiments on widely used benchmarks, including NQ and MS MARCO, show that our method significantly improves retrieval performance on new documents while maintaining effectiveness on the original collection. Moreover, DOME achieves this with only about 60% of the training time required by incremental training, considerably reducing computational cost and enabling efficient, frequent model updates.

生成式检索模型编辑新文档集成高效更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。