arXiv:2608.08768cs.IR2026-08

用简明摘要识别并纠正搜索中的错误延续,提升大模型深搜准确性

BOUND: Brief-Guided Corrective Preference Distillation at Search-Control Boundaries

  • 通过简要摘要捕捉搜索状态,判断是否出现可修正的漂移错误
  • 在六项评测中五项领先,比现有方法最高提升5.6个准确率点
  • 适合需要精准多跳推理的搜索任务研究者与开发者

基于大语言模型的深度搜索代理通过迭代检索与推理完成任务,但局部相关证据易引发持续性错误锚定、约束漂移或局部主题漂移。现有方法多监督轨迹、结果或步骤,却难以区分任务对齐的延续与可能强化漂移的局部合理延续。本文提出 BOUND,一种在搜索控制边界处进行简明引导的纠正性偏好蒸馏框架。针对每个学生模型决策时刻的状态,BOUND 构建一个教师侧的搜索状态简报,保留原始目标与关键约束,同时总结已确认证据、缺失信息及漂移状态。在简报引导下,教师判断学生延续是否存在可能导致后续决策出错的可修正局部搜索控制错误。结合回放结果,决定构建纠正对比(学生修正与原延续)或终止对比(支持答案与无意义检索延续)。每个经验证的状态匹配偏好对都定义了一个搜索控制边界。通过直接偏好优化(DPO)将这些偏好蒸馏至学生模型,而简报与教师侧计算仅限训练阶段。我们在四个多跳问答基准和三个深度搜索基准上评估 BOUND,对六个重新运行基线的基准,有五项表现最优,14项指标中有12项领先。在相同搜索控制接口与匹配设置下,相较轨迹 SFT,BOUND 在 Bamboogle 上提升5.6个 EM 点,BrowseComp-Plus 上提升4.8个准确率点。代码见 https://github.com/RUCAIBox/BOUND。

原文摘要 · Abstract (English)

Large language model (LLM)-based deep search agents solve tasks through iterative retrieval and reasoning, but locally relevant evidence can cause persistent wrong-anchor drift, constraint drift, or local-topic drift. Existing methods supervise trajectories, outcomes, or steps, but rarely distinguish task-aligned continuations from locally plausible ones that reinforce drift. We propose BOUND, a brief-guided corrective preference distillation framework for persistent search drift. For each student-induced decision-time state, BOUND constructs a teacher-side search-state brief that preserves the original search target and key constraints while summarizing confirmed evidence, missing information, and drift status. Guided by the brief, the teacher determines whether the student's continuation contains a correctable local search-control error likely to affect subsequent decisions. Together with the rollout outcome, this assessment determines whether to construct a corrective contrast between a student-specific correction and the original continuation, or a termination contrast between a supported answer and an unnecessary retrieval continuation. Each validated state-matched preference pair operationalizes a search-control boundary. Direct preference optimization (DPO) distills these preferences into the student, while the brief and teacher-side computation remain confined to training. We evaluate BOUND on four multi-hop QA benchmarks and three deep-search benchmarks. Across the six benchmarks for which we reran baselines, BOUND leads on five datasets and 12 of 14 metrics. Under the same search-control interface and matched settings, BOUND outperforms Trajectory SFT by 5.6 EM points on Bamboogle and 4.8 accuracy points on BrowseComp-Plus. Code is available at https://github.com/RUCAIBox/BOUND.

大模型搜索偏好蒸馏多跳推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。