arXiv:2607.08365cs.IR2026-07中稿 · IJCAI

用草稿-验证机制实现搜索推荐的端到端生成,兼顾速度与精度。

DaV-Gen: End-to-End Generative Retrieval via Draft-and-Verify

论文配图:DaV-Gen: End-to-End Generative Retrieval via Draft-and-Verify
图 1 · 摘自论文原文
  • 将生成任务拆为草稿与验证两阶段,统一训练双目标。
  • 推理时先快速向量草稿,再精准融合打分,效率与精度兼得。
  • 适合追求高效高质检索系统的工业场景使用。

主流工业信息检索系统(如搜索与推荐)通常采用多阶段级联架构(MCAs),通过粗到精的“检索-排序”流程在效果与效率间取得平衡。然而各阶段优化目标不一致,导致早期错误被传播甚至放大,最终降低结果质量。尽管新兴的端到端生成模型提供了统一方案,但其在线服务性能受限于标准解码器结构固有的自回归过程。为此,我们提出DaV-Gen,一种基于“草稿-验证”机制的新范式,从根本上重构搜索与推荐的统一架构。受推测解码启发,框架在单个模型内设计协同的两个操作:训练时联合优化候选草稿与细粒度验证,通过复合损失函数同时学习:1)对比损失以构建高效的嵌入空间用于草稿;2)融合损失结合生成似然与向量相似性,生成更优的验证分数。该集成训练策略赋予模型双重能力。推理时,先以高效向量方式生成候选集,再利用更强的融合打分函数进行验证,从而在统一的端到端架构中同时实现稀疏草稿的速度与先进生成模型的精度。

原文摘要 · Abstract (English)

Mainstream industrial information retrieval systems (e.g., search and recommendation) are usually built upon Multi-Stage Cascade Architectures (MCAs), which balance effectiveness and efficiency through a coarse-to-fine ``retrieval-ranking'' pipeline. However, the optimization objectives across different stages are substantially inconsistent, propagating or even amplifying the early-stage errors that ultimately degrade the quality of final results. While emerging end-to-end generative models offer a potential solution by unifying the pipeline, their online serving performance is severely hindered by the auto-regressive process inherited from the standard decoder-only structure. To bridge this gap, we introduce \textbf{DaV-Gen}, a novel unified solution designed to fundamentally refactor the paradigm for both search and recommendation via a ``Draft-and-Verify'' mechanism. Inspired by the process used by speculative decoding, our framework redesigns the generation task into two synergistic operations within a single model. During training, the model is concurrently optimized for both candidate drafting and fine-grained verification. This is achieved by a composite loss function that jointly trains the model on two distinct but related objectives: 1) a contrastive loss that structures the embedding space for efficient drafting, and 2) a fusion loss that combines generative likelihood with vector similarity to produce a superior verification score. This integrated training strategy equips the model with dual capabilities. At inference time, it first performs highly efficient vector-based drafting to generate a candidate set, and then verifies these candidates using the more powerful fused scoring function, thereby achieving both the speed of sparse drafting and the precision of advanced generative models within a unified, end-to-end architecture.

信息检索生成模型端到端推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。